00000001:02000400:2.0F:1783950730.086033:0:3308:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1783950749.047773:0:3528:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783950751.249808:0:3592:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 656 MB/s 00000001:01000000:1.0F:1783950751.499965:0:3592:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 439 MB/s 00000001:01000000:2.0:1783950751.749709:0:3592:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3247 MB/s 00000020:02000000:0.0:1783950752.650534:0:3621:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gb5ded84 00000400:02000000:2.0:1783950753.743591:0:3636:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.202.133@tcp [8/256/0/180] 00008000:02000000:2.0:1783950757.887911:0:3786:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783950819.709237:0:5751:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783950834.702276:0:6501:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783950834.702281:0:6501:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783950834.702282:0:6501:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783950834.702417:0:6501:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000043ecf02c 00000080:02000400:0.0:1783950834.702429:0:6501:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1783950834.711431:0:6501:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1783950834.711445:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783950834.711478:0:6501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000827fcda0) 00000020:00000080:0.0:1783950834.711496:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783950834.784709:0:6501:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1783950834.784789:0:6501:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1783950834.797471:0:6501:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783950834.797667:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783950834.797673:0:6501:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783950834.797682:0:6501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7aeb 00000020:01000004:0.0:1783950834.797688:0:6501:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783950834.797691:0:6501:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783950834.797695:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000043ecf02c from MGS 00000020:01000004:0.0:1783950834.797698:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783950834.797705:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008b2efb03) 00000020:00000080:0.0:1783950834.797713:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783950834.797826:0:6501:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000043ecf02c from MGS, refs=2 00080000:01000000:0.0:1783950834.797831:0:6501:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783950834.797834:0:6501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7af9 00000100:00100000:0.0:1783950834.797908:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783950834.798022:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783950834.798026:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1783950834.798563:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1783950834.798569:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1783950834.799132:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950834.799497:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1783950834.799501:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1783950834.799900:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1783950834.799905:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1783950834.800365:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1783950834.800372:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783950834.800829:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950834.800833:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950834.800835:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950834.801132:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950834.801135:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950834.801136:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950834.801940:0:6501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783950834.811085:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783950835.051291:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4155 MB/s 00000001:01000000:0.0:1783950835.301174:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4247 MB/s 00000001:01000000:1.0:1783950835.553119:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 549 MB/s 00000001:01000000:2.0:1783950835.802918:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 811 MB/s 00080000:10000000:3.0:1783950835.807790:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1783950835.808321:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783950835.816264:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783950835.816984:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783950835.817034:0:6501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783950835.817073:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783950835.817280:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783950835.817302:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783950835.817625:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783950835.817752:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783950835.817981:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783950835.820461:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783950835.820478:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783950835.820852:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783950835.820861:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783950835.821501:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783950835.821524:0:6501:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.133@tcp' 00000020:01000004:1.0:1783950835.821526:0:6501:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783950835.821589:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.133@tcp (typ=mgc) 00000020:00000080:1.0:1783950835.821609:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.133@tcp (000000003c1e7fc4) 00000020:00000080:1.0:1783950835.821628:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783950835.821747:0:6501:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e7969a48@MGC192.168.202.133@tcp: add connection 192.168.202.133@tcp at head 00000100:00080000:0.0:1783950835.821999:0:6521:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1783950835.822659:0:6501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.133@tcp-0 is initialized 00000040:01000000:1.0:1783950835.822667:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 1 is initialized 10000000:01000000:1.0:1783950835.825292:0:6522:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783950835.825345:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.133@tcp (uuid d1065061-5fe9-438e-843f-5f70939080ee) 00000020:00000080:1.0:1783950835.825370:0:6501:0:(genops.c:1406:class_connect()) connect: client d1065061-5fe9-438e-843f-5f70939080ee, cookie 0x7645c8e1169f7b07 00000100:00080000:1.0:1783950835.825382:0:6501:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783950835.825388:0:6501:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import 00000000e7969a48 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783950835.825440:0:6501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003c673038 x1870607944777856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783950835.825469:0:6501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d1065061-5fe9-438e-843f-5f70939080ee->MGS 00000020:01000004:1.0:1783950835.825485:0:6501:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783950835.825490:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783950835.825502:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000686c09fa) 00000020:00000080:1.0:1783950835.825514:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783950835.831133:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c673038 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944777856:0@lo:250: 00000100:00100000:3.0:1783950835.831264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950835.831340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944777856 00000100:00100000:3.0:1783950835.831347:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944777856 00000100:00100000:3.0:1783950835.831389:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783950835.831395:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7dab1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3651:x1870607944777856:12345-0@lo:250: 00010000:00080000:3.0:1783950835.831421:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d1065061-5fe9-438e-843f-5f70939080ee@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1783950835.831455:0:6517:0:(genops.c:1406:class_connect()) connect: client d1065061-5fe9-438e-843f-5f70939080ee, cookie 0x7645c8e1169f7b15 00000100:00080000:3.0:1783950835.831581:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000888160cf : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950835.831635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7dab1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+5:3651:x1870607944777856:12345-0@lo:250: Request processed in 238us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950835.831645:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783950835.831697:0:3651:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783950835.831707:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1783950835.831721:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783950835.831725:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783950835.831728:0:3651:0:(import.c:65:import_set_state_nolock()) 00000000e7969a48 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783950835.831731:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783950835.831734:0:3651:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783950835.831739:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c673038 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944777856:0@lo:250: 00000100:00100000:1.0:1783950835.840186:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950835.840379:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783950835.840385:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783950835.857980:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783950835.857995:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783950835.860712:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783950835.860723:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783950835.861634:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950835.861880:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783950835.861886:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783950835.862414:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783950835.862420:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783950835.893882:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950835.894104:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783950835.894114:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783950835.895300:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783950835.895310:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783950835.896071:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783950835.896317:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783950835.896322:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783950835.896984:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783950835.896992:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783950835.897553:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950835.897685:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783950835.897690:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783950835.898240:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783950835.898247:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783950835.898901:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950835.899093:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783950835.899099:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783950835.900933:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783950835.900944:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783950835.923523:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783950835.923744:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783950835.923750:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783950835.926884:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783950835.926899:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783950835.927785:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783950835.927794:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783950835.930625:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783950835.930679:0:6501:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783950835.930706:0:6501:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783950835.931392:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783950835.931431:0:6501:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1783950835.931436:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783950835.931438:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783950835.931440:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950835.931441:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950835.931443:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950835.931444:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950835.931446:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783950835.931447:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783950835.931448:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950835.931450:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950835.931451:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950835.931453:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783950835.931455:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1783950835.931457:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783950835.931459:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783950835.931460:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950835.931461:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950835.931462:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950835.931463:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950835.931464:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783950835.931465:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783950835.931466:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950835.931467:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950835.931468:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950835.931469:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783950835.931512:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783950835.931530:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010549781 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944777984:0@lo:253: 00000100:00100000:1.0:1783950835.931602:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950835.931701:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1fe8858 going to sleep for 11 seconds 00000100:00100000:0.0:1783950835.934403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944777984 00000100:00100000:0.0:1783950835.934419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944777984 00000100:00100000:0.0:1783950835.934538:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783950835.934548:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+5:6501:x1870607944777984:12345-0@lo:253: 20000000:01000000:0.0:1783950835.934599:0:6520:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783950835.934602:0:6520:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1783950835.936673:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783950835.936746:0:6520:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783950835.937044:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783950835.938713:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1783950835.941973:0:6520:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783950835.941982:0:6520:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1783950835.941989:0:6520:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1783950835.941992:0:6520:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1783950835.942005:0:6520:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1783950835.942480:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783950835.942632:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1783950835.942647:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783950835.942668:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1783950835.942685:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1783950835.942718:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1783950835.942792:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1783950835.942801:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1783950835.942816:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1783950835.942822:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1783950835.942835:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1783950835.942841:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1783950835.942854:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1783950835.942870:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1783950835.942896:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783950835.942902:0:6520:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1783950835.942922:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783950835.943022:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1783950835.943032:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783950835.943049:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1783950835.943067:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1783950835.943082:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1783950835.943098:0:6520:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1783950835.943127:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1783950835.943136:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783950835.943188:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1783950835.943207:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1783950835.943224:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1783950835.943233:0:6520:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1783950835.943260:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1783950835.943268:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1783950835.943283:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1783950835.943313:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1783950835.943380:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1783950835.943404:0:6520:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783950835.943412:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1783950835.944578:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783950835.944798:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783950835.944823:0:6520:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.133@tcp for mdt 20000000:01000000:1.0:1783950835.944832:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:1.0:1783950835.944853:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783950835.944860:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783950835.944875:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783950835.944882:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:1.0:1783950835.944924:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783950835.944934:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783950835.944951:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783950835.944982:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783950835.945013:0:6520:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783950835.945016:0:6520:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783950835.945019:0:6520:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783950835.945061:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783950835.945063:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783950835.945582:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1783950835.945732:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1783950835.945768:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1783950835.945786:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1783950835.945795:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783950835.945798:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783950835.946187:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1783950835.946553:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1783950835.946581:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1783950835.946604:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1783950835.946619:0:6520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783950835.946621:0:6520:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1783950835.946626:0:6520:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783950835.946628:0:6520:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783950835.946633:0:6520:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783950835.946639:0:6520:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783950835.947013:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783950835.947115:0:6520:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783950835.958522:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1783950835.958564:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1783950835.958581:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1783950835.958601:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783950835.958620:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958637:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958647:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958652:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958675:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958681:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958687:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3f36ab7 already unused, calling callback (00000000ec34550f) 00010000:00010000:1.0:1783950835.958690:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958697:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958710:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958717:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950835.958722:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3f36ab7/0x7645c8e1169f7b1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783950835.958739:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783950835.973836:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+5:6501:x1870607944777984:12345-0@lo:253: Request processed in 39280us (42225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950835.973862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783950835.973969:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010549781 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944777984:0@lo:253: 10000000:01000000:3.0:1783950835.973986:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783950835.973989:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783950835.973990:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783950835.973992:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783950835.973993:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1783950835.973994:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783950835.973995:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783950835.973996:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783950835.973997:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783950835.973998:0:6501:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783950835.974000:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783950835.974001:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783950835.974021:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000043ecf02c from lustre-MDT0000 10000000:01000000:3.0:1783950835.974051:0:6501:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783950835.974054:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783950835.974058:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e036d35b380 10000000:01000000:3.0:1783950835.974062:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783950835.974070:0:6501:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e036d35b380 from 1 10000000:01000000:3.0:1783950835.974080:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783950835.974135:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950835.974173:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950835.974183:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950835.974200:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001ca2951f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778112:0@lo:101: 00000100:00100000:3.0:1783950835.974236:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950835.974290:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c620fbd going to sleep for 11 seconds 00000100:00100000:2.0:1783950835.974408:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778112 00000100:00100000:2.0:1783950835.974416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778112 00000100:00100000:2.0:1783950835.974465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783950835.974473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000483c404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+5:6501:x1870607944778112:12345-0@lo:101: 00010000:00010000:2.0:1783950835.974484:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950835.974495:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7b23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950835.974524:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950835.974534:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950835.974542:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e1b4074, rc 0) 00000100:00100000:2.0:1783950835.974593:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000483c404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+6:6501:x1870607944778112:12345-0@lo:101: Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950835.974599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783950835.974689:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001ca2951f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778112:0@lo:101: 00010000:00010000:0.0:1783950835.974701:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.974709:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950835.974781:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778240:0@lo:501: 00000100:00100000:0.0:1783950835.974807:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950835.974824:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc62f5d3 going to sleep for 11 seconds 00000100:00100000:2.0:1783950835.974925:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778240 00000100:00100000:2.0:1783950835.974936:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778240 00000100:00100000:2.0:1783950835.974964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783950835.974970:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e843c9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+6:6501:x1870607944778240:12345-0@lo:501: 00000100:00100000:2.0:1783950835.975042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e843c9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+6:6501:x1870607944778240:12345-0@lo:501: Request processed in 72us (234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783950835.975048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783950835.975167:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778240:0@lo:501: 10000000:01000000:0.0:1783950835.975193:0:6501:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783950835.975211:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975219:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950835.975228:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0343db6000 10000000:01000000:0.0:1783950835.975232:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783950835.975236:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e0343db6000 10000000:01000000:0.0:1783950835.975238:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783950835.975241:0:6501:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e0343db6000 from 1 10000000:01000000:0.0:1783950835.975244:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783950835.975262:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975397:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975404:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950835.975417:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778368:0@lo:101: 00000100:00100000:0.0:1783950835.975442:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950835.975467:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc62f5d3 going to sleep for 11 seconds 00000100:00100000:2.0:1783950835.975515:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778368 00000100:00100000:2.0:1783950835.975520:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778368 00000100:00100000:2.0:1783950835.975547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950835.975553:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc8f035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+6:6501:x1870607944778368:12345-0@lo:101: 00010000:00010000:2.0:1783950835.975561:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950835.975570:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ac9b34a/0x7645c8e1169f7b38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7b31 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950835.975586:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ac9b34a/0x7645c8e1169f7b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7b31 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950835.975593:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ac9b34a/0x7645c8e1169f7b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b31 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950835.975600:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ac9b34a, rc 0) 00000100:00100000:2.0:1783950835.975635:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc8f035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+7:6501:x1870607944778368:12345-0@lo:101: Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950835.975641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783950835.975730:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778368:0@lo:101: 00010000:00010000:0.0:1783950835.975741:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975748:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950835.975770:0:6501:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783950835.975782:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975788:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 000000007bd1c5a9/0x7645c8e1169f7b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950835.975795:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783950835.975798:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783950835.975801:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e0343db6000 10000000:01000000:0.0:1783950835.975804:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783950835.975806:0:6501:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783950835.975814:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783950835.975829:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975835:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.975840:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950835.975851:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778496:0@lo:101: 00000100:00100000:0.0:1783950835.975876:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950835.975944:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc62f5d3 going to sleep for 11 seconds 00000100:00100000:3.0:1783950835.976642:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778496 00000100:00100000:3.0:1783950835.976650:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778496 00000100:00100000:3.0:1783950835.976735:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783950835.976743:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008039cd36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+7:6501:x1870607944778496:12345-0@lo:101: 00010000:00010000:3.0:1783950835.976763:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950835.976778:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7b3f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950835.976797:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950835.976805:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950835.976812:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec85b196, rc 0) 00000100:00100000:3.0:1783950835.976862:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008039cd36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+8:6501:x1870607944778496:12345-0@lo:101: Request processed in 120us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950835.976879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783950835.976950:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778496:0@lo:101: 00010000:00010000:0.0:1783950835.976963:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950835.976971:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950835.977022:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778624:0@lo:501: 00000100:00100000:0.0:1783950835.977046:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950835.977640:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778624 00000100:00100000:2.0:1783950835.977647:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778624 00000100:00100000:2.0:1783950835.977675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783950835.977681:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055ad87ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+8:6501:x1870607944778624:12345-0@lo:501: 00000100:00100000:2.0:1783950835.978071:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055ad87ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+9:6501:x1870607944778624:12345-0@lo:501: Request processed in 388us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950835.978089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783950835.978318:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc62f5d3 going to sleep for 11 seconds 00000100:00100000:1.0:1783950835.978339:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d7c9716 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778624:0@lo:501: 00000100:00100000:1.0:1783950835.978377:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3a3bfd5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778752:0@lo:503: 00000100:00100000:1.0:1783950835.978424:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950835.978438:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a78f042 going to sleep for 11 seconds 00000100:00100000:2.0:1783950835.978493:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778752 00000100:00100000:2.0:1783950835.978498:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778752 00000100:00100000:2.0:1783950835.978533:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783950835.978540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000194f9504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+9:6501:x1870607944778752:12345-0@lo:503: 00000100:00100000:2.0:1783950835.978627:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000194f9504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+9:6501:x1870607944778752:12345-0@lo:503: Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950835.978634:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783950835.978733:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3a3bfd5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944778752:0@lo:503: 00000100:00100000:1.0:1783950835.979259:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3a3bfd5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6547:1870607944778880:0@lo:502: 00000100:00100000:1.0:1783950835.979302:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950835.979329:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e575272b going to sleep for 11 seconds 00000100:00100000:3.0:1783950835.979399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944778880 00000100:00100000:3.0:1783950835.979405:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944778880 00000100:00100000:3.0:1783950835.979432:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950835.979437:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea75dff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+9:6547:x1870607944778880:12345-0@lo:502: 00000100:00100000:3.0:1783950835.979542:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea75dff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+9:6547:x1870607944778880:12345-0@lo:502: Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950835.979549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783950835.979741:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3a3bfd5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6547:1870607944778880:0@lo:502: 00000020:01000000:0.0:1783950835.979844:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950835.979855:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950835.979858:0:6547:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783950835.979862:0:6547:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783950835.979864:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783950835.979879:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000137a8547) 00000020:00000080:0.0:1783950835.979902:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783950835.979917:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783950835.979993:0:6547:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783950835.980000:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7b54 00000020:00000080:0.0:1783950835.980484:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783950835.980489:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950835.980493:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950835.980495:0:6547:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783950835.980498:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950835.980502:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950835.980503:0:6547:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783950835.980507:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783950835.980514:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003df35641) 00000020:00000080:0.0:1783950835.980524:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783950835.980527:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783950835.980529:0:6547:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783950835.980532:0:6547:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783950835.980538:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783950835.980587:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000043ecf02c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783950835.980607:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000053ae58b1) 00000020:00000080:0.0:1783950835.980616:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783950835.980676:0:6547:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783950835.980683:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7b69 00000020:00000080:0.0:1783950835.980891:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783950835.980898:0:6547:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783950835.980904:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7645c8e1169f7b70 00080000:01000000:0.0:1783950835.980919:0:6547:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783950835.980923:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7b77 00080000:10000000:0.0:1783950835.981388:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783950835.981533:0:6547:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783950835.989631:0:6547:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783950836.064078:0:6547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783950836.064447:0:6547:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1783950836.071472:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783950836.071816:0:6547:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783950836.074109:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b3af83b3) 00000020:00000080:3.0:1783950836.074130:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783950836.074416:0:6547:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783950836.074425:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7b85 00000020:00000080:2.0:1783950836.077102:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1783950836.078115:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1783950836.084363:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1783950836.086991:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.097995:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.101034:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.110539:0:6547:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1783950836.116409:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7645c8e1169f7b8c 00000020:00000080:0.0:1783950836.116965:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783950836.116983:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950836.116989:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950836.116991:0:6547:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783950836.116994:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950836.116998:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950836.116999:0:6547:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783950836.117002:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783950836.117004:0:6547:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783950836.117006:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950836.117008:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950836.117009:0:6547:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783950836.117011:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950836.117016:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950836.117017:0:6547:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783950836.117021:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783950836.117063:0:6547:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1783950836.117121:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6547:1870607944779008:0@lo:502: 00000100:00100000:0.0:1783950836.117235:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950836.117284:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4ad18a0 going to sleep for 11 seconds 00000100:00100000:1.0:1783950836.117871:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779008 00000100:00100000:1.0:1783950836.117879:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779008 00000100:00100000:1.0:1783950836.117935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783950836.117944:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047df5b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+9:6547:x1870607944779008:12345-0@lo:502: 00000100:00100000:1.0:1783950836.118073:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047df5b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+9:6547:x1870607944779008:12345-0@lo:502: Request processed in 131us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950836.118082:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783950836.118449:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6547:1870607944779008:0@lo:502: 00000020:01000000:0.0:1783950836.118478:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950836.118484:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950836.118487:0:6547:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1783950836.118491:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783950836.118767:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783950836.118793:0:6501:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783950836.118812:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.118823:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950836.118831:0:6501:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0343db6000 from 1 10000000:01000000:1.0:1783950836.118833:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783950836.118862:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.118869:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.118876:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950836.118905:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052950f37 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779136:0@lo:101: 00000100:00100000:1.0:1783950836.118951:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.118985:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e575272b going to sleep for 11 seconds 00000100:00100000:0.0:1783950836.119118:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779136 00000100:00100000:0.0:1783950836.119123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779136 00000100:00100000:0.0:1783950836.119196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783950836.119203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000121c6908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+9:6501:x1870607944779136:12345-0@lo:101: 00010000:00010000:0.0:1783950836.119214:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950836.119228:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7b93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.119260:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.119271:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.119279:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000155eee60, rc 0) 00000100:00100000:0.0:1783950836.119317:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000121c6908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+10:6501:x1870607944779136:12345-0@lo:101: Request processed in 115us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950836.119323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783950836.119399:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052950f37 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779136:0@lo:101: 00010000:00010000:2.0:1783950836.119412:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950836.119419:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950836.121436:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000011be00e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779264:0@lo:256: 00000100:00100000:2.0:1783950836.121493:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950836.121525:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 000000006caeb316 going to sleep for 11 seconds 00000100:00100000:0.0:1783950836.121629:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779264 00000100:00100000:0.0:1783950836.121635:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779264 00000100:00100000:0.0:1783950836.121670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783950836.121675:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070e042a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+10:6501:x1870607944779264:12345-0@lo:256: 20000000:01000000:0.0:1783950836.121691:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783950836.121695:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783950836.121744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070e042a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+10:6501:x1870607944779264:12345-0@lo:256: Request processed in 69us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950836.121749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783950836.121927:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000011be00e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779264:0@lo:256: 10000000:01000000:1.0:1783950836.122494:0:6501:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783950836.122509:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.122519:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950836.122525:0:6501:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db6000 from 1 10000000:01000000:1.0:1783950836.122528:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783950836.122553:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.122559:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.122566:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950836.122577:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779392:0@lo:101: 00000100:00100000:1.0:1783950836.122608:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.122634:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000033fcc1d going to sleep for 11 seconds 00000100:00100000:0.0:1783950836.122927:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779392 00000100:00100000:0.0:1783950836.122933:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779392 00000100:00100000:0.0:1783950836.122971:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783950836.122977:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8df04b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+10:6501:x1870607944779392:12345-0@lo:101: 00010000:00010000:0.0:1783950836.122987:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950836.122999:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7ba1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.123017:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.123035:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.123042:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fd0619c, rc 0) 00000100:00100000:0.0:1783950836.123069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8df04b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+11:6501:x1870607944779392:12345-0@lo:101: Request processed in 92us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950836.123075:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783950836.123238:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779392:0@lo:101: 00010000:00010000:1.0:1783950836.123250:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.123262:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950836.123312:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779520:0@lo:501: 00000100:00100000:1.0:1783950836.123338:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.123393:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000033fcc1d going to sleep for 11 seconds 00000100:00100000:2.0:1783950836.123551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779520 00000100:00100000:2.0:1783950836.123556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779520 00000100:00100000:2.0:1783950836.123608:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783950836.123614:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bb69195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+11:6501:x1870607944779520:12345-0@lo:501: 00000100:00100000:2.0:1783950836.123741:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bb69195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+11:6501:x1870607944779520:12345-0@lo:501: Request processed in 128us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950836.123746:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783950836.123795:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779520:0@lo:501: 00000100:00100000:1.0:1783950836.123814:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779648:0@lo:503: 00000100:00100000:1.0:1783950836.123842:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.124018:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000033fcc1d going to sleep for 11 seconds 00000100:00100000:0.0:1783950836.124093:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779648 00000100:00100000:0.0:1783950836.124097:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779648 00000100:00100000:0.0:1783950836.124113:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783950836.124117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e4e27ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+11:6501:x1870607944779648:12345-0@lo:503: 00000040:00080000:0.0:1783950836.124166:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783950836.124245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e4e27ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+11:6501:x1870607944779648:12345-0@lo:503: Request processed in 127us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950836.124251:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783950836.124389:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779648:0@lo:503: 00000040:00080000:0.0:1783950836.125275:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1783950836.125444:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783950836.125459:0:6501:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783950836.125498:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.125509:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950836.125565:0:6501:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783950836.125568:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0343db6000 10000000:01000000:1.0:1783950836.125570:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0343db6000 10000000:01000000:1.0:1783950836.125574:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783950836.125578:0:6501:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0343db6000 from 1 10000000:01000000:1.0:1783950836.125580:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783950836.125606:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.125618:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.125625:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950836.125637:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779776:0@lo:101: 00000100:00100000:1.0:1783950836.125671:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.125725:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1fe8858 going to sleep for 11 seconds 00000100:00100000:0.0:1783950836.125824:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779776 00000100:00100000:0.0:1783950836.125828:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779776 00000100:00100000:0.0:1783950836.125935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783950836.125944:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+11:6501:x1870607944779776:12345-0@lo:101: 00010000:00010000:0.0:1783950836.125956:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950836.125968:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7baf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.125988:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.125996:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.126009:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097664742, rc 0) 00000100:00100000:0.0:1783950836.126044:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944779776:12345-0@lo:101: Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950836.126050:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783950836.126109:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779776:0@lo:101: 00010000:00010000:1.0:1783950836.126119:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.126127:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950836.126186:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779904:0@lo:501: 00000100:00100000:1.0:1783950836.126210:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.126324:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1fe8858 going to sleep for 11 seconds 00000100:00100000:2.0:1783950836.126407:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944779904 00000100:00100000:2.0:1783950836.126412:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944779904 00000100:00100000:2.0:1783950836.126435:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783950836.126440:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf7c696 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944779904:12345-0@lo:501: 00000100:00100000:2.0:1783950836.126550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf7c696 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944779904:12345-0@lo:501: Request processed in 109us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950836.126556:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783950836.126615:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944779904:0@lo:501: 00000100:00100000:1.0:1783950836.126636:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944780032:0@lo:503: 00000100:00100000:1.0:1783950836.126667:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.126684:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1fe8858 going to sleep for 11 seconds 00000100:00100000:2.0:1783950836.126723:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780032 00000100:00100000:2.0:1783950836.126726:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780032 00000100:00100000:2.0:1783950836.126741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783950836.126744:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000676ddf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944780032:12345-0@lo:503: 00000100:00100000:2.0:1783950836.126824:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000676ddf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944780032:12345-0@lo:503: Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950836.126828:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783950836.126991:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944780032:0@lo:503: 00000100:00100000:1.0:1783950836.127443:0:6552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6552:1870607944780160:0@lo:502: 00000100:00100000:1.0:1783950836.127476:0:6552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.127500:0:6552:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa3a8039 going to sleep for 11 seconds 00000100:00100000:2.0:1783950836.127538:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780160 00000100:00100000:2.0:1783950836.127542:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780160 00000100:00100000:2.0:1783950836.127567:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783950836.127571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d814882b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6552:x1870607944780160:12345-0@lo:502: 00000100:00100000:2.0:1783950836.127642:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d814882b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6552:x1870607944780160:12345-0@lo:502: Request processed in 70us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950836.127648:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783950836.127726:0:6552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6552:1870607944780160:0@lo:502: 00000020:01000004:1.0:1783950836.127782:0:6552:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783950836.127796:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000058327c0f) 00000020:00000080:1.0:1783950836.127815:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783950836.128067:0:6552:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000043ecf02c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783950836.128071:0:6552:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000043ecf02c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783950836.128073:0:6552:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000043ecf02c 4 00010000:00080000:1.0:1783950836.128094:0:6552:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000082591f36@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1783950836.129671:0:6552:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783950836.129770:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783950836.129800:0:6552:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783950836.129808:0:6552:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7645c8e1169f7bc4 00000100:00080000:1.0:1783950836.129815:0:6552:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783950836.129819:0:6552:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000082591f36 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783950836.129842:0:6552:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000041014ef8 x1870607944780288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783950836.131866:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944780288:0@lo:38: 00000100:00100000:1.0:1783950836.131956:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783950836.132017:0:6552:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783950836.132216:0:6552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6552:1870607944780416:0@lo:502: 00000100:00100000:1.0:1783950836.132263:0:6552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.132293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780416 00000100:00100000:1.0:1783950836.132300:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780416 00000100:00100000:1.0:1783950836.132341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783950836.132349:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bca69364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6552:x1870607944780416:12345-0@lo:502: 00000100:00100000:1.0:1783950836.132460:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bca69364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:6552:x1870607944780416:12345-0@lo:502: Request processed in 111us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950836.132469:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783950836.132504:0:6552:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa3a8039 going to sleep for 11 seconds 00000100:00100000:1.0:1783950836.132522:0:6552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:6552:1870607944780416:0@lo:502: 00000040:00080000:1.0:1783950836.132546:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1783950836.132742:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780288 00000100:00100000:2.0:1783950836.132747:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780288 00000100:00100000:2.0:1783950836.132790:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783950836.132801:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6407c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944780288:12345-0@lo:38: 00000100:00100000:2.0:1783950836.132844:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6407c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944780288:12345-0@lo:38: Request processed in 42us (889us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783950836.132851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1783950836.132871:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783950836.132890:0:6501:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783950836.132903:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950836.132929:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783950836.132972:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783950836.132974:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783950836.132976:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950836.132977:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950836.132978:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950836.132979:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950836.132981:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950836.132982:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783950836.132984:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950836.132985:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950836.132986:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950836.132988:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783950836.132991:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783950836.132994:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783950836.132996:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783950836.132997:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950836.132998:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950836.132999:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950836.133000:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950836.133001:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950836.133001:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783950836.133002:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950836.133003:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950836.133004:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950836.133009:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783950836.133022:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783950836.133030:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c0f25b89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944780544:0@lo:253: 00000100:00100000:2.0:1783950836.133059:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950836.133071:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set 00000000424a5d22 going to sleep for 11 seconds 00000100:00100000:3.0:1783950836.134049:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780544 00000100:00100000:3.0:1783950836.134056:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780544 00000100:00100000:3.0:1783950836.134095:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783950836.134102:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3850df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944780544:12345-0@lo:253: 20000000:01000000:3.0:1783950836.134127:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783950836.134154:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783950836.134802:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783950836.134812:0:3651:0:(import.c:65:import_set_state_nolock()) 0000000082591f36 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783950836.134817:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783950836.134820:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944780288:0@lo:38: 20000000:01000000:2.0:1783950836.143539:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783950836.143560:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783950836.143816:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783950836.143821:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783950836.143840:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.143858:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.143866:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.143921:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.143936:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 12 pid: 6520 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950836.143950:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944780672:0@lo:104: 00000100:00100000:0.0:1783950836.144018:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950836.144077:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 0000000028a050ab going to sleep for 11 seconds 00000100:00100000:3.0:1783950836.144224:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780672 00000100:00100000:3.0:1783950836.144232:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780672 00000100:00100000:3.0:1783950836.144281:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783950836.144289:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000279ab9ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944780672:12345-0@lo:104: 00010000:00010000:3.0:1783950836.144313:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950836.144373:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783950836.144379:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000279ab9ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944780672:12345-0@lo:104: Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950836.144387:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783950836.144447:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950836.144453:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144461:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3f36ab7 already unused, calling callback (000000006bf39712) 10000000:00010000:1.0:1783950836.144464:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144471:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950836.144478:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950836.144484:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950836.144519:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144538:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950836.144556:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144563:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7b93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b9a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144581:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950836.144583:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950836.144584:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950836.144641:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944780800:0@lo:103: 00000100:00100000:1.0:1783950836.144673:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950836.144742:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780800 00000100:00100000:1.0:1783950836.144746:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780800 00010000:00010000:1.0:1783950836.144773:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 13 pid: 6520 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950836.144795:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950836.144801:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb2efe3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+13:3653:x1870607944780800:12345-0@lo:103: 00010000:00010000:1.0:1783950836.144810:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950836.144814:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 13 pid: 6520 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144823:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 13 pid: 6520 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144837:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144855:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783950836.144868:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001047178s 00010000:00010000:1.0:1783950836.144872:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144878:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144884:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144890:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144895:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bac82027 already unused, calling callback (00000000ec34550f) 00010000:00010000:1.0:1783950836.144898:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144904:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144924:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950836.144933:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950836.144960:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb2efe3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+13:3653:x1870607944780800:12345-0@lo:103: Request processed in 159us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950836.144967:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950836.145009:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944780800:0@lo:103: 00000100:00100000:1.0:1783950836.145346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3850df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+12:6501:x1870607944780544:12345-0@lo:253: Request processed in 11244us (12286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950836.145354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783950836.145469:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c0f25b89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:6501:1870607944780544:0@lo:253: 10000000:01000000:2.0:1783950836.145483:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783950836.145486:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783950836.145488:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783950836.145490:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950836.145491:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950836.145493:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950836.145496:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950836.145498:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950836.145499:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783950836.145501:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950836.145503:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950836.145504:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950836.145505:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783950836.145517:0:6501:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783950836.146741:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000155eee60/0x7645c8e1169f7b9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7b93 expref: 11 pid: 6520 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950836.146771:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944780672:0@lo:104: 00010000:00010000:0.0:1783950836.146793:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.146819:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.146824:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950836.146830:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bac82027/0x7645c8e1169f7bcb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783950836.153956:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.154174:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783950836.154394:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.154553:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783950836.154731:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.154943:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783950836.160074:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.160415:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783950836.160646:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.161044:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783950836.162104:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1783950836.162322:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1783950836.167647:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1783950836.182057:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783950836.183184:0:6557:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1783950836.183191:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783950836.183570:0:6558:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783950836.186598:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783950836.186719:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783950836.187235:0:6501:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783950836.187242:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783950836.187347:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783950836.188450:0:6558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783950836.195294:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783950836.197346:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783950836.197422:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783950836.197706:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783950836.199092:0:6501:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1783950836.201590:0:6558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783950836.201680:0:6558:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783950836.201684:0:6558:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1783950836.202624:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783950836.203837:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783950836.204377:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783950836.204526:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783950836.204640:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783950836.204831:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783950836.204997:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783950836.205110:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783950836.207014:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783950836.207705:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783950836.207903:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783950836.208063:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783950836.208243:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783950836.208404:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783950836.208554:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783950836.208685:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783950836.209590:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783950836.210094:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783950836.210266:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783950836.210446:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783950836.210572:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783950836.210725:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783950836.211478:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783950836.211622:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783950836.211845:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783950836.212015:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783950836.212304:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783950836.212465:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783950836.212603:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783950836.212766:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783950836.212926:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783950836.213065:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783950836.214032:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1783950836.222072:0:6501:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783950836.222127:0:6501:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb8e801c7b988 00100000:10000000:3.0:1783950836.222135:0:6501:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783950836.223115:0:6501:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783950836.223136:0:6501:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783950836.223344:0:6501:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783950836.223367:0:6501:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783950836.224215:0:6501:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950836.224399:0:6501:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1783950836.835577:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950837.856286:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950838.880378:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950839.904285:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950840.931824:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950841.443418:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944780928:0@lo:400: 00000100:00100000:2.0:1783950841.443530:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950841.443775:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944780928 00000100:00100000:3.0:1783950841.443788:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944780928 00000100:00100000:3.0:1783950841.443874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783950841.443886:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000986b761b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+11:3654:x1870607944780928:12345-0@lo:400: 00000100:00080000:0.0:1783950841.443971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783950841.443977:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783950841.443982:0:37:0:(import.c:65:import_set_state_nolock()) 0000000082591f36 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783950841.443993:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000082591f36 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783950841.444029:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d4a98d27 x1870607944781056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783950841.444082:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d4a98d27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944781056:0@lo:38: 00000100:00100000:0.0:1783950841.444124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950841.444674:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000986b761b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+11:3654:x1870607944780928:12345-0@lo:400: Request processed in 790us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950841.444686:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783950841.444796:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781056 00000100:00100000:3.0:1783950841.444803:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781056 00000100:00100000:3.0:1783950841.444827:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783950841.444842:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd93a5dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607944781056:12345-0@lo:38: 00010000:00080000:3.0:1783950841.444878:0:6527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1783950841.444926:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7645c8e1169f7bd2 00000004:00100000:3.0:1783950841.444981:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783950841.445460:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000bb3ef6b0 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950841.445733:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd93a5dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1870607944781056:12345-0@lo:38: Request processed in 899us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950841.445743:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783950841.445844:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d4a98d27 x1870607944781056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783950851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783950841.445871:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783950841.445880:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783950841.445886:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783950841.445889:0:3651:0:(import.c:65:import_set_state_nolock()) 0000000082591f36 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783950841.445896:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d4a98d27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944781056:0@lo:38: 00000100:00100000:2.0:1783950841.446437:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944780928:0@lo:400: 00000001:02000400:1.0:1783950841.788874:0:6802:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783950841.958256:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783950842.760834:0:6855:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950842.763932:0:6855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783950842.986269:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950844.001609:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783950844.001961:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783950844.001968:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0343db6000 from 3 10000000:01000000:2.0:1783950844.001975:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783950844.002044:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950844.002060:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950844.002072:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950844.002104:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c0f25b89 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944781184:0@lo:101: 00000100:00100000:2.0:1783950844.002226:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950844.002307:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec575cab going to sleep for 11 seconds 00000100:00100000:1.0:1783950844.002494:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781184 00000100:00100000:1.0:1783950844.002505:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781184 00000100:00100000:1.0:1783950844.002671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783950844.002681:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000107fb52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+11:6522:x1870607944781184:12345-0@lo:101: 00010000:00010000:1.0:1783950844.002700:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950844.002735:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7bd9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950844.002764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950844.002776:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950844.002787:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000ba7010, rc 0) 00000100:00100000:1.0:1783950844.002895:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000107fb52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+12:6522:x1870607944781184:12345-0@lo:101: Request processed in 214us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950844.002904:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783950844.010711:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c0f25b89 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944781184:0@lo:101: 00010000:00010000:3.0:1783950844.010754:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950844.010770:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950844.010885:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944781312:0@lo:256: 00000100:00100000:3.0:1783950844.010969:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950844.011091:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 000000007616a0e5 going to sleep for 11 seconds 00000100:00100000:0.0:1783950844.011214:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781312 00000100:00100000:0.0:1783950844.011222:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781312 00000100:00100000:0.0:1783950844.014631:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783950844.014664:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072ec10e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+12:6522:x1870607944781312:12345-0@lo:256: 20000000:01000000:0.0:1783950844.014708:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783950844.014738:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783950844.014746:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1783950844.014935:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072ec10e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+12:6522:x1870607944781312:12345-0@lo:256: Request processed in 288us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950844.014943:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783950844.016814:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944781312:0@lo:256: 10000000:01000000:3.0:1783950844.016924:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783950844.016937:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950844.016950:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950845.030791:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783950845.812466:0:6956:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783950845.812718:0:6956:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783950846.048867:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950846.561033:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944781440:0@lo:400: 00000100:00100000:0.0:1783950846.561181:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950846.561318:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781440 00000100:00100000:2.0:1783950846.561330:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781440 00000100:00100000:2.0:1783950846.561395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783950846.561404:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000772524dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:3655:x1870607944781440:12345-0@lo:400: 00000100:00100000:3.0:1783950846.561566:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a33f2dc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944781568:0@lo:400: 00000100:00100000:3.0:1783950846.561611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950846.561674:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781568 00000100:00100000:3.0:1783950846.561679:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781568 00000100:00100000:3.0:1783950846.561715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783950846.561721:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c36b608 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944781568:12345-0@lo:400: 00000100:00100000:3.0:1783950846.561772:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c36b608 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944781568:12345-0@lo:400: Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950846.561781:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783950846.561869:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a33f2dc7 x1870607944781568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950846.561887:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a33f2dc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944781568:0@lo:400: 00000100:00100000:2.0:1783950846.567726:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000772524dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:3655:x1870607944781440:12345-0@lo:400: Request processed in 6307us (6531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950846.567877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783950846.568606:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944781440:0@lo:400: 00010000:00010000:1.0:1783950847.079339:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950848.096859:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950849.121220:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950850.145093:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950851.178304:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950851.682606:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950851.682629:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944781696:0@lo:400: 00000100:00100000:3.0:1783950851.682695:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950851.682745:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a33f2dc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944781824:0@lo:400: 00000100:00100000:3.0:1783950851.684443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950851.684515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781696 00000100:00100000:3.0:1783950851.684523:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781696 00000100:00100000:3.0:1783950851.684569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783950851.684576:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005099b3b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+12:3652:x1870607944781696:12345-0@lo:400: 00000100:00100000:3.0:1783950851.684637:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005099b3b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+12:3652:x1870607944781696:12345-0@lo:400: Request processed in 61us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950851.684645:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783950851.684696:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944781696:0@lo:400: 00000100:00100000:1.0:1783950851.686434:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781824 00000100:00100000:1.0:1783950851.686446:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781824 00000100:00100000:1.0:1783950851.686506:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783950851.686513:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069c3caa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944781824:12345-0@lo:400: 00000100:00100000:1.0:1783950851.686595:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069c3caa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944781824:12345-0@lo:400: Request processed in 83us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950851.686603:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783950851.687385:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a33f2dc7 x1870607944781824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950851.687400:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a33f2dc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944781824:0@lo:400: 00010000:00010000:1.0:1783950852.192240:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950853.217385:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950854.241057:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950855.264293:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783950855.821426:0:7454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783950855.821432:0:7454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783950855.821433:0:7454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783950855.821634:0:7454:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000698d7c5d 00000020:01000004:2.0:1783950855.821656:0:7454:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1783950855.821670:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783950855.821698:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000002ca6d7f8) 00000020:00000080:2.0:1783950855.821722:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783950855.883670:0:7454:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1783950855.883783:0:7454:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1783950855.911550:0:7454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783950855.911869:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783950855.911882:0:7454:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783950855.911899:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f7bee 00000020:01000004:2.0:1783950855.911908:0:7454:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783950855.911935:0:7454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783950855.911939:0:7454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783950855.911947:0:7454:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783950855.911982:0:7454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783950855.911986:0:7454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783950855.935386:0:7454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783950855.935447:0:7454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1783950855.935452:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783950855.935454:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783950855.935456:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950855.935457:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950855.935458:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950855.935460:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950855.935461:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950855.935463:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950855.935465:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950855.935467:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950855.935468:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783950855.935472:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1783950855.935476:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783950855.935478:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783950855.935479:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950855.935486:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950855.935487:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950855.935488:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950855.935488:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950855.935495:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950855.935496:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950855.935497:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950855.935499:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783950855.935536:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783950855.935562:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004eaac14d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944781952:0@lo:253: 00000100:00100000:2.0:1783950855.936356:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950855.936425:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000049cb84ee going to sleep for 11 seconds 00000100:00100000:1.0:1783950855.941615:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944781952 00000100:00100000:1.0:1783950855.941633:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944781952 00000100:00100000:1.0:1783950855.941756:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783950855.941769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874d3e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:7454:x1870607944781952:12345-0@lo:253: 20000000:01000000:1.0:1783950855.941814:0:6520:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783950855.941819:0:6520:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1783950855.941825:0:6520:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1783950855.941829:0:6520:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1783950855.941878:0:6520:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1783950855.942199:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783950855.942356:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1783950855.942388:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783950855.942575:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1783950855.942600:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1783950855.942620:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1783950855.942689:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1783950855.942698:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1783950855.942715:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1783950855.942738:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1783950855.942757:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1783950855.942764:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1783950855.942778:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1783950855.942797:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1783950855.942910:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1783950855.942921:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:1.0:1783950855.942937:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1783950855.942944:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783950855.942960:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1783950855.942967:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:1.0:1783950855.942984:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1783950855.943003:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783950855.943024:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1783950855.943043:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1783950855.943056:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1783950855.943182:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1783950855.943194:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1783950855.943213:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1783950855.943235:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1783950855.943254:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1783950855.943262:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1783950855.943279:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1783950855.943305:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1783950855.943312:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1783950855.943336:0:6520:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783950855.943343:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1783950855.952137:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1783950855.952603:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1783950855.952634:0:6520:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.133@tcp for mdt 20000000:01000000:1.0:1783950855.952636:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:1.0:1783950855.952655:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1783950855.952661:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783950855.952679:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1783950855.952685:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:1.0:1783950855.952705:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1783950855.952713:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1783950855.952814:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1783950855.952838:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1783950855.952893:0:6520:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1783950855.952902:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1783950855.955012:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1783950855.955306:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1783950855.955346:0:6520:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.202.133@tcp for mdt 20000000:01000000:2.0:1783950855.955349:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:2.0:1783950855.955372:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1783950855.955380:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783950855.955398:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1783950855.955404:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:2.0:1783950855.955418:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1783950855.955426:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1783950855.955443:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1783950855.955461:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1783950855.955494:0:6520:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783950855.955497:0:6520:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783950855.955501:0:6520:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783950855.955599:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783950855.955603:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783950855.956717:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1783950855.956847:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1783950855.956879:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1783950855.957091:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1783950855.957122:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1783950855.957525:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1783950855.957544:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783950855.957547:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783950855.958016:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1783950855.958061:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1783950855.958081:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1783950855.960026:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1783950855.960065:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1783950855.960083:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1783950855.960096:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1783950855.960099:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783950855.960644:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783950855.960670:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783950855.960688:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1783950855.960963:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1783950855.960987:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1783950855.961006:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1783950855.961023:0:6520:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783950855.961026:0:6520:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783950855.961031:0:6520:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783950855.961039:0:6520:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783950855.961900:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1783950855.962022:0:6520:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783950855.979328:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783950855.979833:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.979853:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.979860:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.979866:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.979872:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.979912:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.979924:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950855.979937:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a33f2dc7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6520:1870607944782080:0@lo:104: 00000100:00100000:3.0:1783950855.980000:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950855.980091:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.980099:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950855.980114:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6520:1870607944782208:0@lo:104: 00000100:00100000:3.0:1783950855.980134:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950855.984044:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782080 00000100:00100000:2.0:1783950855.984055:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782080 00000100:00100000:2.0:1783950855.984096:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782208 00000100:00100000:2.0:1783950855.984099:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782208 00000100:00100000:2.0:1783950855.984115:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950855.984121:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874bac20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:6520:x1870607944782080:12345-0@lo:104: 00010000:00010000:2.0:1783950855.984195:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950855.984306:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783950855.984311:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874bac20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:6520:x1870607944782080:12345-0@lo:104: Request processed in 190us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950855.984319:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950855.984335:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783950855.984340:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e11742b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+3:6520:x1870607944782208:12345-0@lo:104: 00010000:00010000:2.0:1783950855.984346:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984479:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783950855.984485:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984492:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d65e22e3 already unused, calling callback (000000006bf39712) 10000000:00010000:1.0:1783950855.984495:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984503:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950855.984509:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950855.984513:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950855.984580:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984586:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950855.984606:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984611:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7baf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7bb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984622:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950855.984624:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984628:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7adfe62 already unused, calling callback (000000006bf39712) 10000000:00010000:1.0:1783950855.984630:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984635:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950855.984639:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950855.984643:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950855.984652:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984656:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950855.984668:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984681:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000c7adfe62/0x7645c8e1169f7b3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b46 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984690:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950855.984691:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950855.984693:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950855.984699:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950855.984713:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abf6af4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944782464:0@lo:103: 00000100:00100000:1.0:1783950855.984764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950855.984801:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782464 00000100:00100000:1.0:1783950855.984805:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782464 00010000:00010000:1.0:1783950855.984824:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 13 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950855.984844:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783950855.984850:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000233fb8cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+13:3653:x1870607944782464:12345-0@lo:103: 00010000:00010000:1.0:1783950855.984859:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950855.984864:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 13 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984871:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 13 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.984888:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950855.984914:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000233fb8cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+13:3653:x1870607944782464:12345-0@lo:103: Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950855.984920:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783950855.984952:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abf6af4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944782464:0@lo:103: 00000100:00100000:3.0:1783950855.985295:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944782336:0@lo:103: 00000100:00100000:3.0:1783950855.985328:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950855.985391:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.985402:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950855.985411:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6520:1870607944782592:0@lo:104: 00000100:00100000:3.0:1783950855.985435:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950855.985448:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ae133bf8 going to sleep for 11 seconds 00000100:00100000:3.0:1783950855.985460:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a33f2dc7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6520:1870607944782080:0@lo:104: 00010000:00010000:3.0:1783950855.985468:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec85b196/0x7645c8e1169f7b46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7b3f expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950855.985477:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6520:1870607944782208:0@lo:104: 00000100:00100000:0.0:1783950855.985921:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783950855.985931:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1783950855.985995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782336 00000100:00100000:1.0:1783950855.986000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782336 00010000:00010000:1.0:1783950855.986019:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950855.986047:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783950855.986052:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fcf2fc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+12:3655:x1870607944782336:12345-0@lo:103: 00010000:00010000:1.0:1783950855.986061:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950855.986064:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986073:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986085:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000097664742/0x7645c8e1169f7bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7baf expref: 12 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986096:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950855.986127:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fcf2fc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+11:3655:x1870607944782336:12345-0@lo:103: Request processed in 75us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950855.986133:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950855.986333:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041014ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944782336:0@lo:103: 00000100:00100000:1.0:1783950855.986510:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782592 00000100:00100000:1.0:1783950855.986515:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782592 00000100:00100000:0.0:1783950855.986682:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783950855.986688:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ffda474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6520:x1870607944782592:12345-0@lo:104: 00010000:00010000:0.0:1783950855.986697:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950855.986832:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783950855.986838:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ffda474 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6520:x1870607944782592:12345-0@lo:104: Request processed in 150us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950855.986844:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783950855.986889:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950855.986895:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986902:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de664b02 already unused, calling callback (000000006bf39712) 10000000:00010000:1.0:1783950855.986905:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986929:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950855.986934:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950855.986939:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950855.986969:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986975:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950855.986991:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.986997:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000de664b02/0x7645c8e1169f7b23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7b2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987011:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950855.987013:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950855.987014:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950855.987026:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abf6af4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944782720:0@lo:103: 00000100:00100000:1.0:1783950855.987057:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950855.987096:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782720 00000100:00100000:1.0:1783950855.987100:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782720 00010000:00010000:1.0:1783950855.987113:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 11 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950855.987133:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783950855.987138:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1e2dcd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+11:3653:x1870607944782720:12345-0@lo:103: 00010000:00010000:1.0:1783950855.987187:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950855.987191:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 11 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987200:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 11 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987215:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987221:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987235:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987240:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987246:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987252:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987257:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c81f59bf already unused, calling callback (00000000ec34550f) 00010000:00010000:1.0:1783950855.987260:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987265:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987285:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950855.987296:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950855.987324:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1e2dcd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+11:3653:x1870607944782720:12345-0@lo:103: Request processed in 187us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950855.987331:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783950855.987359:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abf6af4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944782720:0@lo:103: 00010000:00010000:3.0:1783950855.989037:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7b2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7b23 expref: 10 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950855.989059:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6520:1870607944782592:0@lo:104: 00010000:00010000:3.0:1783950855.989092:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.989121:0:6520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.989126:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950855.989132:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c81f59bf/0x7645c8e1169f7bf5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783950855.989218:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:2.0:1783950855.989349:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783950855.989358:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e11742b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+3:6520:x1870607944782208:12345-0@lo:104: Request processed in 5017us (9222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950855.989367:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783950855.992092:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950856.001523:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874d3e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+9:7454:x1870607944781952:12345-0@lo:253: Request processed in 59751us (65162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.001538:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783950856.001648:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004eaac14d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944781952:0@lo:253: 10000000:01000000:2.0:1783950856.001665:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783950856.001669:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783950856.001671:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783950856.001672:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950856.001673:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1783950856.001674:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950856.001689:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950856.001691:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950856.001692:0:7454:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783950856.001694:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950856.001695:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783950856.001718:0:7454:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000698d7c5d from lustre-MDT0001 10000000:01000000:2.0:1783950856.001762:0:7454:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783950856.001765:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783950856.001774:0:7454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e036d35b380 local copy 10000000:01000000:2.0:1783950856.001777:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783950856.001813:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.001825:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.001834:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950856.001851:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004eaac14d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944782848:0@lo:101: 00000100:00100000:2.0:1783950856.001886:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950856.001933:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018fa28d1 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.002083:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782848 00000100:00100000:3.0:1783950856.002090:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782848 00000100:00100000:3.0:1783950856.002171:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783950856.002180:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068e2de96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+9:7454:x1870607944782848:12345-0@lo:101: 00010000:00010000:3.0:1783950856.002195:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950856.002211:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004373ebba/0x7645c8e1169f7c03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7bfc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002234:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004373ebba/0x7645c8e1169f7c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7bfc expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002245:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004373ebba/0x7645c8e1169f7c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7bfc expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002254:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004373ebba, rc 0) 00000100:00100000:3.0:1783950856.002294:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068e2de96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+10:7454:x1870607944782848:12345-0@lo:101: Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.002309:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783950856.002398:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004eaac14d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944782848:0@lo:101: 00010000:00010000:2.0:1783950856.002412:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.002421:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950856.002518:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004eaac14d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944782976:0@lo:501: 00000100:00100000:2.0:1783950856.002551:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950856.002595:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018fa28d1 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.002702:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944782976 00000100:00100000:3.0:1783950856.002708:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944782976 00000100:00100000:3.0:1783950856.002755:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783950856.002761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cfb9c5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+10:7454:x1870607944782976:12345-0@lo:501: 00000100:00100000:3.0:1783950856.002825:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cfb9c5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+10:7454:x1870607944782976:12345-0@lo:501: Request processed in 65us (275us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783950856.002832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783950856.002855:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004eaac14d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944782976:0@lo:501: 10000000:01000000:3.0:1783950856.002867:0:7454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783950856.002888:0:7454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783950856.002892:0:7454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002900:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002906:0:7454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002921:0:7454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783950856.002941:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0377b14000 10000000:01000000:3.0:1783950856.002945:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783950856.002948:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e036d35b380 10000000:01000000:3.0:1783950856.002950:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783950856.002953:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e036d35b380 from 1 10000000:01000000:3.0:1783950856.002955:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783950856.002977:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002983:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.002989:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.003001:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783104:0@lo:101: 00000100:00100000:3.0:1783950856.003024:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.003032:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.003051:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783104 00000100:00100000:3.0:1783950856.003054:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783104 00000100:00100000:3.0:1783950856.003071:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783950856.003076:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000523d59ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+10:7454:x1870607944783104:12345-0@lo:101: 00010000:00010000:3.0:1783950856.003083:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950856.003091:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5d5a201/0x7645c8e1169f7c11 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7c0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003103:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5d5a201/0x7645c8e1169f7c11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7c0a expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003110:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5d5a201/0x7645c8e1169f7c11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c0a expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003115:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5d5a201, rc 0) 00000100:00100000:3.0:1783950856.003166:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000523d59ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+11:7454:x1870607944783104:12345-0@lo:101: Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.003171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783950856.003203:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783104:0@lo:101: 00010000:00010000:3.0:1783950856.003212:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003219:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950856.003232:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783950856.003243:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003249:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000bc93d066/0x7645c8e1169f7c0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950856.003255:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e0377b14000 10000000:01000000:3.0:1783950856.003259:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783950856.003261:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e0377b14000 from 1 10000000:01000000:3.0:1783950856.003263:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783950856.003275:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003280:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003286:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.003294:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783232:0@lo:101: 00000100:00100000:3.0:1783950856.003316:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.003324:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.003353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783232 00000100:00100000:3.0:1783950856.003356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783232 00000100:00100000:3.0:1783950856.003373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783950856.003378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c98e26f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+11:7454:x1870607944783232:12345-0@lo:101: 00010000:00010000:3.0:1783950856.003384:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950856.003390:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be6ddfa6/0x7645c8e1169f7c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7c18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003403:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be6ddfa6/0x7645c8e1169f7c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7c18 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003410:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be6ddfa6/0x7645c8e1169f7c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c18 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003416:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be6ddfa6, rc 0) 00000100:00100000:3.0:1783950856.003442:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c98e26f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:7454:x1870607944783232:12345-0@lo:101: Request processed in 64us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.003447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783950856.003469:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783232:0@lo:101: 00010000:00010000:3.0:1783950856.003478:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003484:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950856.003493:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783950856.003500:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003514:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 000000003ba07dc2/0x7645c8e1169f7c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950856.003521:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783950856.003524:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783950856.003527:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e0377b14000 10000000:01000000:3.0:1783950856.003529:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783950856.003531:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783950856.003532:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783950856.003546:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003551:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003556:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.003565:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783360:0@lo:101: 00000100:00100000:3.0:1783950856.003605:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.003614:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.003635:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783360 00000100:00100000:3.0:1783950856.003638:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783360 00000100:00100000:3.0:1783950856.003654:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783950856.003658:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a13c207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+12:7454:x1870607944783360:12345-0@lo:101: 00010000:00010000:3.0:1783950856.003664:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950856.003684:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6199f3f/0x7645c8e1169f7c2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7c26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003704:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6199f3f/0x7645c8e1169f7c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003710:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6199f3f/0x7645c8e1169f7c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003716:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6199f3f, rc 0) 00000100:00100000:3.0:1783950856.003757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a13c207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783360:12345-0@lo:101: Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.003763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783950856.003785:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783360:0@lo:101: 00010000:00010000:3.0:1783950856.003793:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.003800:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.003858:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783488:0@lo:501: 00000100:00100000:3.0:1783950856.003880:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.003887:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.003903:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783488 00000100:00100000:3.0:1783950856.003906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783488 00000100:00100000:3.0:1783950856.003921:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783950856.003925:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000089b725a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783488:12345-0@lo:501: 00000100:00100000:3.0:1783950856.004015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000089b725a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783488:12345-0@lo:501: Request processed in 89us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.004021:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783950856.004051:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783488:0@lo:501: 00000100:00100000:3.0:1783950856.004074:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783616:0@lo:503: 00000100:00100000:3.0:1783950856.004117:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.004127:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.004174:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783616 00000100:00100000:3.0:1783950856.004178:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783616 00000100:00100000:3.0:1783950856.004196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783950856.004202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064d472dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783616:12345-0@lo:503: 00000100:00100000:3.0:1783950856.004292:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064d472dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783616:12345-0@lo:503: Request processed in 90us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.004299:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783950856.004337:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783616:0@lo:503: 00000040:00080000:3.0:1783950856.004594:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783950856.004669:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783744:0@lo:502: 00000100:00100000:3.0:1783950856.004705:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.004714:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.004745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783744 00000100:00100000:3.0:1783950856.004749:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783744 00000100:00100000:3.0:1783950856.004766:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783950856.004770:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046a3a0ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783744:12345-0@lo:502: 00000100:00100000:3.0:1783950856.004840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046a3a0ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783744:12345-0@lo:502: Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.004847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783950856.004875:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783744:0@lo:502: 00000040:00080000:3.0:1783950856.005040:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783950856.005069:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1783950856.005094:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1783950856.005109:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1783950856.005124:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1783950856.005163:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1783950856.005184:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1783950856.005200:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1783950856.005215:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1783950856.005229:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1783950856.005243:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1783950856.005257:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1783950856.005271:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1783950856.005284:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1783950856.005309:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1783950856.005326:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1783950856.005342:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1783950856.005358:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1783950856.005372:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1783950856.005388:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1783950856.005404:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1783950856.005419:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1783950856.005432:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1783950856.005451:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783872:0@lo:502: 00000100:00100000:3.0:1783950856.005485:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.005494:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d43a0270 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.005515:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944783872 00000100:00100000:3.0:1783950856.005518:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944783872 00000100:00100000:3.0:1783950856.005536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783950856.005541:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011e97234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783872:12345-0@lo:502: 00000100:00100000:3.0:1783950856.005617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011e97234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944783872:12345-0@lo:502: Request processed in 75us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.005623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783950856.005661:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944783872:0@lo:502: 00000040:00080000:3.0:1783950856.005699:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1783950856.005708:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:1.0:1783950856.006075:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950856.006081:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.006091:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eefd877e already unused, calling callback (000000006bf39712) 10000000:00010000:1.0:1783950856.006093:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.006100:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950856.006106:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950856.006111:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950856.006133:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.006162:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950856.006184:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.006201:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000eefd877e/0x7645c8e1169f7bfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7c03 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.006214:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950856.006215:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950856.006217:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950856.006224:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783950856.006235:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abf6af4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944784000:0@lo:103: 00000100:00100000:1.0:1783950856.006267:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.006305:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784000 00000100:00100000:1.0:1783950856.006309:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784000 00000100:00100000:1.0:1783950856.006343:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950856.006349:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d945a8f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+13:3655:x1870607944784000:12345-0@lo:103: 00010000:00010000:1.0:1783950856.006358:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950856.006380:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004373ebba/0x7645c8e1169f7c03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7bfc expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.006393:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950856.006421:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d945a8f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+12:3655:x1870607944784000:12345-0@lo:103: Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950856.006427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950856.006452:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abf6af4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944784000:0@lo:103: 00000020:01000000:1.0:1783950856.011545:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783950856.011560:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950856.011562:0:7467:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783950856.011569:0:7467:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783950856.011572:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783950856.011597:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000005d809745) 00000020:00000080:1.0:1783950856.011619:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1783950856.011625:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783950856.011702:0:7467:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783950856.011708:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f7c3b 00000020:00000080:1.0:1783950856.012025:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783950856.012031:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783950856.012035:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950856.012036:0:7467:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783950856.012039:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783950856.012043:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950856.012044:0:7467:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783950856.012047:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783950856.012062:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000faa0b0b9) 00000020:00000080:1.0:1783950856.012073:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1783950856.012079:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783950856.012081:0:7467:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783950856.012084:0:7467:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783950856.012089:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783950856.012134:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000698d7c5d from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783950856.012169:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a7c4acc2) 00000020:00000080:1.0:1783950856.012178:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1783950856.012245:0:7467:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783950856.012252:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7c50 00000020:00000080:1.0:1783950856.012335:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783950856.012342:0:7467:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783950856.012347:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7645c8e1169f7c57 00080000:01000000:1.0:1783950856.012352:0:7467:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783950856.012356:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f7c5e 00080000:10000000:1.0:1783950856.013488:0:7467:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1783950856.013624:0:7467:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1783950856.198751:0:7467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1783950856.199079:0:7467:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1783950856.206118:0:7467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1783950856.206532:0:7467:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783950856.229550:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1783950856.229565:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950856.229572:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.229574:0:7467:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1783950856.229579:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950856.229585:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.229586:0:7467:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1783950856.229589:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783950856.229595:0:7467:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:2.0:1783950856.229623:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783950856.229640:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000004318a891) 00000020:00000080:2.0:1783950856.229664:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783950856.229670:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783950856.230130:0:7467:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1783950856.230138:0:7467:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783950856.230830:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f7c6c 00010000:00080000:2.0:1783950856.230880:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000082bcbdb6@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783950856.242180:0:7467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1783950856.248593:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783950856.248610:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783950856.248658:0:7467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783950856.248681:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7c73 00000100:00080000:2.0:1783950856.248692:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783950856.248697:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000082bcbdb6 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783950856.248808:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008b8872b8 x1870607944784128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783950856.248865:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b8872b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944784128:0@lo:38: 00000100:00100000:1.0:1783950856.248949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.249043:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784128 00000100:00100000:3.0:1783950856.249058:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784128 00000100:00100000:3.0:1783950856.249135:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783950856.249198:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001abf6af4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944784128:12345-0@lo:38: 00010000:00080000:3.0:1783950856.249235:0:6530:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1783950856.249279:0:6530:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7c7a 00000004:00100000:3.0:1783950856.249300:0:6530:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783950856.249308:0:6530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1783950856.249387:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1783950856.249476:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950856.249481:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.249489:0:7467:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1783950856.249493:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783950856.249496:0:7467:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1783950856.249498:0:7467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783950856.249500:0:7467:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783950856.249501:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783950856.249505:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.249508:0:7467:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783950856.249511:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950856.249517:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.249519:0:7467:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1783950856.249524:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783950856.249563:0:7467:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783950856.249577:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950856.249580:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.249581:0:7467:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1783950856.249584:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950856.249587:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.249589:0:7467:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783950856.249591:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783950856.249593:0:7467:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783950856.249625:0:7467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950856.249628:0:7467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950856.249630:0:7467:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783950856.249633:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1783950856.249720:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1783950856.249789:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783950856.249828:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.249843:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000871a10f2/0x7645c8e1169f7c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950856.249853:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 1 10000000:01000000:3.0:1783950856.249856:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783950856.249892:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.249900:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.249910:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.249951:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784256:0@lo:101: 00000100:00100000:3.0:1783950856.250027:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.250073:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8dd83b3 going to sleep for 11 seconds 00000100:00100000:0.0:1783950856.250118:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfe74d2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944784384:0@lo:400: 00000100:00100000:0.0:1783950856.250205:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950856.250335:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784256 00000100:00100000:2.0:1783950856.250343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784256 00000100:00100000:2.0:1783950856.250385:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783950856.250393:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb9ee3b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+12:7454:x1870607944784256:12345-0@lo:101: 00010000:00010000:2.0:1783950856.250410:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950856.250426:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7c81 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.250461:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.250471:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.250482:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5c7e4e0, rc 0) 00000100:00100000:2.0:1783950856.250743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb9ee3b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944784256:12345-0@lo:101: Request processed in 350us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.250752:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783950856.252628:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784384 00000100:00100000:3.0:1783950856.252642:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784384 00000100:00100000:3.0:1783950856.252700:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950856.252709:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008783c52b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944784384:12345-0@lo:400: 00000100:00100000:3.0:1783950856.252827:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008783c52b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944784384:12345-0@lo:400: Request processed in 119us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.252834:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950856.252888:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784256:0@lo:101: 00010000:00080000:2.0:1783950856.252920:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bfe74d2f x1870607944784384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950856.252940:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfe74d2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944784384:0@lo:400: 00010000:00010000:3.0:1783950856.253063:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950856.253078:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.253660:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784512:0@lo:256: 00000100:00100000:3.0:1783950856.253708:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.254116:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8dd83b3 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.259295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784512 00000100:00100000:3.0:1783950856.259314:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784512 00000100:00100000:3.0:1783950856.259407:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783950856.259422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd0ccca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944784512:12345-0@lo:256: 20000000:01000000:3.0:1783950856.259460:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783950856.260136:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783950856.260186:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783950856.260325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd0ccca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944784512:12345-0@lo:256: Request processed in 907us (6617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.260335:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783950856.260690:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed493744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784512:0@lo:256: 10000000:01000000:0.0:1783950856.261336:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783950856.261365:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.261378:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950856.261387:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 1 10000000:01000000:0.0:1783950856.261391:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783950856.261427:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.261435:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.261444:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950856.261464:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d09a0e74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784640:0@lo:101: 00000100:00100000:0.0:1783950856.261503:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950856.261543:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b44c8187 going to sleep for 11 seconds 00000100:00100000:2.0:1783950856.261589:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784640 00000100:00100000:2.0:1783950856.261605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784640 00000100:00100000:2.0:1783950856.261672:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783950856.261682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f445fd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+13:7454:x1870607944784640:12345-0@lo:101: 00010000:00010000:2.0:1783950856.261702:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950856.261729:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7c8f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.261764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.261777:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.261804:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a175950, rc 0) 00000100:00100000:2.0:1783950856.261874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f445fd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:7454:x1870607944784640:12345-0@lo:101: Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.261881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783950856.262929:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d09a0e74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784640:0@lo:101: 00010000:00010000:0.0:1783950856.262955:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.262967:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950856.263116:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d09a0e74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784768:0@lo:501: 00000100:00100000:0.0:1783950856.263384:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950856.263443:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b44c8187 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.263520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784768 00000100:00100000:3.0:1783950856.263526:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784768 00000100:00100000:3.0:1783950856.263594:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783950856.263605:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a429ffbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:7454:x1870607944784768:12345-0@lo:501: 00000100:00100000:3.0:1783950856.263761:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a429ffbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:7454:x1870607944784768:12345-0@lo:501: Request processed in 157us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.263769:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1783950856.264043:0:6530:0:(import.c:65:import_set_state_nolock()) 00000000de2cf138 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783950856.264193:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001abf6af4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607944784128:12345-0@lo:38: Request processed in 14995us (15242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.264211:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783950856.264369:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783950856.264383:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783950856.264394:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783950856.264400:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783950856.264403:0:3651:0:(import.c:65:import_set_state_nolock()) 0000000082bcbdb6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783950856.264418:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d09a0e74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784768:0@lo:501: 00000100:00100000:2.0:1783950856.264422:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b8872b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944784128:0@lo:38: 00000100:00100000:1.0:1783950856.264497:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae6b33eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784896:0@lo:503: 00000100:00100000:1.0:1783950856.264559:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950856.264568:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950856.264580:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083cb76b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944785024:0@lo:41: 00000100:00100000:0.0:1783950856.264621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.264671:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000082c09a68 going to sleep for 11 seconds 00000100:00100000:2.0:1783950856.264760:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785024 00000100:00100000:2.0:1783950856.264767:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785024 00000100:00100000:2.0:1783950856.264807:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950856.264814:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000859ed10a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944785024:12345-0@lo:41: 00000004:00000024:2.0:1783950856.264844:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1783950856.264899:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000859ed10a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944785024:12345-0@lo:41: Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.264907:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950856.264941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944784896 00000100:00100000:2.0:1783950856.264944:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944784896 00000100:00100000:2.0:1783950856.264965:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783950856.264970:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cada31de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:7454:x1870607944784896:12345-0@lo:503: 00000040:00080000:2.0:1783950856.265014:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783950856.265063:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083cb76b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944785024:0@lo:41: 00000100:00100000:2.0:1783950856.266360:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cada31de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:7454:x1870607944784896:12345-0@lo:503: Request processed in 1384us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.266386:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783950856.266610:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae6b33eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944784896:0@lo:503: 00000040:00080000:0.0:1783950856.268611:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783950856.268705:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1783950856.269449:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783950856.270845:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1783950856.271521:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783950856.271576:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783950856.271598:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.271616:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950856.271703:0:7454:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783950856.271707:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0377b14000 10000000:01000000:1.0:1783950856.271711:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0377b14000 10000000:01000000:1.0:1783950856.271716:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783950856.271732:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377b14000 from 1 10000000:01000000:1.0:1783950856.271735:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783950856.271783:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.271790:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.271802:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950856.271831:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785152:0@lo:101: 00000100:00100000:1.0:1783950856.271935:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.271995:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0efae93 going to sleep for 11 seconds 00000100:00100000:2.0:1783950856.272002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785152 00000100:00100000:2.0:1783950856.272021:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785152 00000100:00100000:2.0:1783950856.272093:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783950856.272103:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d67afc21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+14:7454:x1870607944785152:12345-0@lo:101: 00010000:00010000:2.0:1783950856.272123:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950856.272167:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eefd877e/0x7645c8e1169f7ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7c9d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.272210:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eefd877e/0x7645c8e1169f7ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.272224:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eefd877e/0x7645c8e1169f7ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.272233:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eefd877e, rc 0) 00000100:00100000:2.0:1783950856.272316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d67afc21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785152:12345-0@lo:101: Request processed in 214us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.272322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783950856.272560:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785152:0@lo:101: 00010000:00010000:1.0:1783950856.272636:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.272647:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950856.272800:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785280:0@lo:501: 00000100:00100000:1.0:1783950856.272835:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.272865:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0efae93 going to sleep for 11 seconds 00000100:00100000:2.0:1783950856.272974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785280 00000100:00100000:2.0:1783950856.272982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785280 00000100:00100000:2.0:1783950856.273027:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783950856.273034:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032a94fe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785280:12345-0@lo:501: 00000100:00100000:2.0:1783950856.273352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032a94fe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785280:12345-0@lo:501: Request processed in 318us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.273361:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783950856.273396:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785280:0@lo:501: 00000100:00100000:1.0:1783950856.273431:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785408:0@lo:503: 00000100:00100000:1.0:1783950856.273479:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.273504:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0efae93 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.273822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785408 00000100:00100000:3.0:1783950856.273829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785408 00000100:00100000:3.0:1783950856.273863:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783950856.273869:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed3e6b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785408:12345-0@lo:503: 00000100:00100000:3.0:1783950856.273993:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed3e6b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785408:12345-0@lo:503: Request processed in 124us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.274000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783950856.274046:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785408:0@lo:503: 00000040:00080000:2.0:1783950856.275127:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783950856.275275:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b8872b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785536:0@lo:502: 00000100:00100000:2.0:1783950856.275342:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950856.275383:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c957d17 going to sleep for 11 seconds 00000100:00100000:0.0:1783950856.276717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785536 00000100:00100000:0.0:1783950856.276755:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785536 00000100:00100000:0.0:1783950856.276834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783950856.276846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f8846cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785536:12345-0@lo:502: 00000100:00100000:0.0:1783950856.277076:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f8846cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785536:12345-0@lo:502: Request processed in 232us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.277085:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783950856.277275:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b8872b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785536:0@lo:502: 00000040:00080000:2.0:1783950856.277596:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783950856.277638:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783950856.277655:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783950856.277673:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783950856.277690:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783950856.277705:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783950856.277720:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783950856.277750:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783950856.277767:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783950856.277782:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783950856.277798:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783950856.277813:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783950856.277830:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783950856.277847:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783950856.277864:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783950856.277882:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783950856.277917:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783950856.277935:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783950856.277951:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783950856.277965:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783950856.277979:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783950856.277994:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783950856.278008:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783950856.278023:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783950856.278042:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783950856.278054:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783950856.278068:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783950856.278082:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1783950856.278135:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b8872b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785664:0@lo:502: 00000100:00100000:2.0:1783950856.278229:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950856.278278:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000549a9d9e going to sleep for 11 seconds 00000100:00100000:1.0:1783950856.278341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785664 00000100:00100000:1.0:1783950856.278356:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785664 00000100:00100000:1.0:1783950856.278435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783950856.278446:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f21c974b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785664:12345-0@lo:502: 00000100:00100000:1.0:1783950856.278650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f21c974b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785664:12345-0@lo:502: Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950856.278664:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783950856.278691:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b8872b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785664:0@lo:502: 00000040:00080000:0.0:1783950856.278769:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1783950856.278779:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783950856.279466:0:7473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783950856.279485:0:7473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000aa784cba) 00000020:00000080:0.0:1783950856.279514:0:7473:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783950856.280938:0:7473:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000698d7c5d from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783950856.280947:0:7473:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000698d7c5d from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783950856.280965:0:7473:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000698d7c5d 3 00010000:00080000:0.0:1783950856.281009:0:7473:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003d992955@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783950856.285972:0:7473:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1783950856.286135:0:7473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783950856.286225:0:7473:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783950856.286265:0:7473:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7645c8e1169f7cb2 00000100:00080000:0.0:1783950856.286280:0:7473:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783950856.286286:0:7473:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003d992955 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783950856.286338:0:7473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000034c9752c x1870607944785792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783950856.286370:0:7473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783950856.286437:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034c9752c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944785792:0@lo:38: 00000100:00100000:2.0:1783950856.286524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950856.288131:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785792 00000100:00100000:0.0:1783950856.288174:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785792 00000100:00100000:0.0:1783950856.288230:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783950856.288240:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b5698b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944785792:12345-0@lo:38: 00010000:00080000:0.0:1783950856.288273:0:6526:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1783950856.288326:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7645c8e1169f7cb9 00000004:00100000:0.0:1783950856.288342:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783950856.288375:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000a6aa28f7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783950856.288461:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b5698b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1870607944785792:12345-0@lo:38: Request processed in 221us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.288470:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783950856.288545:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000034c9752c x1870607944785792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783950866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950856.288562:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783950856.288585:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783950856.288597:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783950856.288604:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783950856.288607:0:3651:0:(import.c:65:import_set_state_nolock()) 000000003d992955 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1783950856.288607:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1783950856.288621:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034c9752c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944785792:0@lo:38: 40000000:00080000:3.0:1783950856.288721:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1783950856.289003:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1783950856.289039:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783950856.289067:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.289077:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000d65e22e3/0x7645c8e1169f7c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783950856.289138:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783950856.289160:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783950856.289162:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950856.289163:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950856.289164:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950856.289165:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950856.289166:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783950856.289167:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950856.289168:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950856.289170:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950856.289171:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783950856.289175:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1783950856.289177:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783950856.289178:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783950856.289180:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950856.289181:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950856.289182:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950856.289183:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950856.289184:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783950856.289427:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950856.289429:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950856.289430:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950856.289431:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783950856.289454:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1783950856.289469:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785920:0@lo:253: 00000100:00100000:1.0:1783950856.289521:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.289568:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.289642:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944785920 00000100:00100000:3.0:1783950856.289652:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944785920 00000100:00100000:3.0:1783950856.289713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1783950856.289734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950856.289736:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c196ebb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785920:12345-0@lo:253: 20000000:01000000:3.0:1783950856.289770:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783950856.289788:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783950856.292991:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1783950856.294216:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783950856.294242:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783950856.294515:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783950856.294520:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783950856.294539:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.294578:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.294585:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.294591:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.294628:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.294640:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 15 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950856.294653:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000999fd5be pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944786048:0@lo:104: 00000100:00100000:0.0:1783950856.294710:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783950856.294771:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.294779:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 15 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950856.294787:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000067c419 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944786176:0@lo:104: 00000100:00100000:0.0:1783950856.294807:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950856.294831:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 00000000faeeb7cf going to sleep for 11 seconds 00000100:00100000:2.0:1783950856.295078:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786048 00000100:00100000:2.0:1783950856.295087:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786048 00000100:00100000:2.0:1783950856.295138:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786176 00000100:00100000:2.0:1783950856.295166:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786176 00000100:00100000:2.0:1783950856.295184:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950856.295264:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019590313 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944786048:12345-0@lo:104: 00010000:00010000:2.0:1783950856.295279:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295334:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783950856.295339:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019590313 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944786048:12345-0@lo:104: Request processed in 78us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.295346:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950856.295362:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783950856.295367:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e3c9368 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944786176:12345-0@lo:104: 00010000:00010000:2.0:1783950856.295373:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295403:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783950856.295407:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e3c9368 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944786176:12345-0@lo:104: Request processed in 41us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.295424:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783950856.295446:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783950856.295451:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295459:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c38a2fb already unused, calling callback (000000006bf39712) 10000000:00010000:2.0:1783950856.295461:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295469:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950856.295476:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950856.295481:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783950856.295509:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295516:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950856.295531:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295537:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 000000004c38a2fb/0x7645c8e1169f7c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c88 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295550:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783950856.295551:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295568:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f3369b83 already unused, calling callback (000000006bf39712) 10000000:00010000:2.0:1783950856.295569:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295575:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950856.295580:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950856.295584:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783950856.295595:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295600:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950856.295613:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295618:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000f3369b83/0x7645c8e1169f7bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7be0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295631:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950856.295632:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950856.295633:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950856.295646:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b857560 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944786432:0@lo:103: 00000100:00100000:2.0:1783950856.295681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950856.295749:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786432 00000100:00100000:2.0:1783950856.295753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786432 00010000:00010000:2.0:1783950856.295782:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 16 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950856.295814:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950856.295819:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000923acfb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+16:3654:x1870607944786432:12345-0@lo:103: 00010000:00010000:2.0:1783950856.295831:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950856.295838:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 16 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295848:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 16 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950856.295864:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950856.295889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000923acfb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+16:3654:x1870607944786432:12345-0@lo:103: Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950856.295895:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783950856.295960:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b857560 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944786432:0@lo:103: 00000100:00100000:2.0:1783950856.296269:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783950856.296283:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001ff22682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944786304:0@lo:103: 00000100:00100000:2.0:1783950856.296317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950856.296349:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950856.296393:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786304 00000100:00100000:2.0:1783950856.296397:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000999fd5be pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944786048:0@lo:104: 00010000:00010000:2.0:1783950856.296409:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7be0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7bd9 expref: 15 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950856.296413:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786304 00000100:00100000:2.0:1783950856.296425:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000067c419 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944786176:0@lo:104: 00010000:00010000:2.0:1783950856.296449:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.296452:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 15 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950856.296510:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783950856.296518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9e4349 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+15:3652:x1870607944786304:12345-0@lo:103: 00010000:00010000:1.0:1783950856.296533:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950856.296539:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 15 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.296553:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 15 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950856.296626:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c196ebb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:7454:x1870607944785920:12345-0@lo:253: Request processed in 6903us (7103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.296636:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783950856.296748:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003b378bd9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:7454:1870607944785920:0@lo:253: 10000000:01000000:2.0:1783950856.296773:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783950856.296777:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783950856.296779:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783950856.296781:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950856.296782:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950856.296783:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950856.296785:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950856.296786:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783950856.296787:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950856.296788:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950856.296789:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950856.296791:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783950856.296803:0:7454:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783950856.297684:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d5c7e4e0/0x7645c8e1169f7c88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7c81 expref: 14 pid: 6519 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297709:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297717:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783950856.297749:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003229354s 00010000:00010000:1.0:1783950856.297755:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297761:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297767:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297786:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297793:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f40bddfd already unused, calling callback (00000000ec34550f) 00010000:00010000:1.0:1783950856.297798:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297805:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297833:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950856.297847:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950856.297937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9e4349 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+13:3652:x1870607944786304:12345-0@lo:103: Request processed in 1420us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950856.297947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783950856.299046:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.299069:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950856.299075:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f40bddfd/0x7645c8e1169f7cc0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950856.301768:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001ff22682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944786304:0@lo:103: 00080000:10000000:2.0:1783950856.308409:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1783950856.308708:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783950856.308947:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783950856.309138:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783950856.313501:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783950856.313830:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783950856.314809:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783950856.315414:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783950856.315778:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1783950856.316082:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783950856.316510:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1783950856.316797:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1783950856.319069:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1783950856.319171:0:7478:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783950856.319180:0:7478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783950856.319767:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1783950856.319822:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7479:1870607944786560:0@lo:700: 00000100:00100000:3.0:1783950856.319889:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.319969:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c44bd689 going to sleep for 11 seconds 00000100:00100000:1.0:1783950856.319986:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786560 00000100:00100000:1.0:1783950856.320000:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786560 00000040:01000000:2.0:1783950856.320085:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783950856.320103:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950856.320128:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a33f2dc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1870607944786560:12345-0@lo:700: 00000100:00100000:1.0:1783950856.320820:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944786688:0@lo:1000: 00000100:00100000:1.0:1783950856.320900:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.320959:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.321022:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786688 00000100:00100000:3.0:1783950856.321029:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786688 00000100:00100000:3.0:1783950856.321085:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950856.321098:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000233fb8cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944786688:12345-0@lo:1000: 00000100:00100000:3.0:1783950856.321228:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000233fb8cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944786688:12345-0@lo:1000: Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.321237:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783950856.321285:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944786688:0@lo:1000: 00000040:01000000:1.0:1783950856.321333:0:7480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1783950856.321380:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944786816:0@lo:700: 00000100:00100000:1.0:1783950856.321430:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.321470:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set 00000000499b21f2 going to sleep for 11 seconds 00000100:00100000:0.0:1783950856.321527:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786816 00000100:00100000:0.0:1783950856.321535:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786816 00000100:00100000:0.0:1783950856.321572:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783950856.321579:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1e2dcd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944786816:12345-0@lo:700: 00000100:00100000:0.0:1783950856.321638:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1e2dcd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944786816:12345-0@lo:700: Request processed in 60us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.321644:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950856.321690:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944786816:0@lo:700: 00000100:00100000:1.0:1783950856.321753:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7480:1870607944786944:0@lo:900: 00000100:00100000:1.0:1783950856.321788:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950856.321812:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set 00000000499b21f2 going to sleep for 11 seconds 00000100:00100000:0.0:1783950856.321849:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944786944 00000100:00100000:0.0:1783950856.321856:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944786944 00000040:01000000:2.0:1783950856.321938:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1783950856.321953:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783950856.321964:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d945a8f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7480:x1870607944786944:12345-0@lo:900: 00000100:00100000:0.0:1783950856.322030:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d945a8f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7480:x1870607944786944:12345-0@lo:900: Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.322037:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1783950856.322098:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1783950856.322099:0:7480:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bb2efe3c x1870607944786944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783950872 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950856.322125:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7480:1870607944786944:0@lo:900: 00000100:00100000:3.0:1783950856.322286:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c91ffd0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944787072:0@lo:1000: 00000100:00100000:3.0:1783950856.322324:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.322346:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944787072 00000100:00100000:3.0:1783950856.322349:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944787072 00000100:00100000:3.0:1783950856.322376:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783950856.322389:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024bdc377 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944787072:12345-0@lo:1000: 00000100:00100000:3.0:1783950856.322448:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024bdc377 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944787072:12345-0@lo:1000: Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.322455:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783950856.322474:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set 00000000033fcc1d going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.322486:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c91ffd0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944787072:0@lo:1000: 00000004:00080000:3.0:1783950856.322550:0:7480:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000029c8bffd with version 0 00000020:00100000:3.0:1783950856.322567:0:7480:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783950856.322573:0:7480:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009c91ffd0 x1870607944787328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783950856.322585:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c91ffd0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944787328:0@lo:1000: 00000100:00100000:3.0:1783950856.322610:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.322628:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944787328 00000100:00100000:3.0:1783950856.322632:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944787328 00000100:00100000:3.0:1783950856.322647:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783950856.322652:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c35eff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944787328:12345-0@lo:1000: 00000004:00000080:2.0:1783950856.322693:0:7454:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783950856.322704:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1783950856.322967:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783950856.323084:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d14098b9 going to sleep for 11 seconds 00000040:00080000:2.0:1783950856.324126:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783950856.325747:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783950856.325795:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1783950856.326517:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783950856.326912:0:7454:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000001:00080000:1.0:1783950856.329082:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1783950856.329346:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c35eff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944787328:12345-0@lo:1000: Request processed in 6683us (6725us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783950856.329365:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1783950856.329386:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1783950856.329393:0:7480:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783950856.329413:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c91ffd0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944787328:0@lo:1000: 00000100:00100000:1.0:1783950856.329499:0:7480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a50df9fa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944787456:0@lo:1000: 40000000:02000000:0.0:1783950856.329530:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1783950856.330766:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.331255:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944787456 00000100:00100000:3.0:1783950856.331271:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944787456 00000100:00100000:3.0:1783950856.331337:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783950856.331348:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f754a54e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944787456:12345-0@lo:1000: 00000100:00100000:3.0:1783950856.331481:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f754a54e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1870607944787456:12345-0@lo:1000: Request processed in 136us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950856.331490:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:2.0:1783950856.333678:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783950856.333989:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783950856.334166:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783950856.334349:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783950856.334514:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:1.0:1783950856.335002:0:7480:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f87caef going to sleep for 11 seconds 00000100:00100000:1.0:1783950856.335048:0:7480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a50df9fa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1870607944787456:0@lo:1000: 00000040:00080000:1.0:1783950856.335083:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1783950856.335124:0:7480:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d777b2b2 with version 1 00000004:00080000:3.0:1783950856.335229:0:7470:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000030bc9d26 version 1 rpc_version 1 00000020:00100000:3.0:1783950856.335283:0:7470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783950856.335296:0:7470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c76545b8 x1870607944787712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783950856.335328:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c76545b8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7470:1870607944787712:0@lo:1000: 00000100:00100000:3.0:1783950856.335436:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950856.335495:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003b7d0af going to sleep for 11 seconds 00000100:00100000:3.0:1783950856.335521:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944787712 00000100:00100000:3.0:1783950856.335529:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944787712 00000100:00100000:3.0:1783950856.335590:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950856.335600:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b8e472 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1870607944787712:12345-0@lo:1000: 00000100:00100000:0.0:1783950856.336712:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a33f2dc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1870607944786560:12345-0@lo:700: Request processed in 16594us (16818us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950856.336741:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783950856.337191:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000090b84510 x1870607944786560/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783950872 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950856.337208:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7479:1870607944786560:0@lo:700: 40000000:02000000:3.0:1783950856.337224:0:7479:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1783950856.337528:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783950856.339597:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783950856.339793:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000040:00080000:1.0:1783950856.340543:0:7480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783950856.340633:0:7480:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1783950856.341573:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783950856.341765:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783950856.344547:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783950856.344741:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783950856.348889:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000001:00080000:0.0:1783950856.349099:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1783950856.350446:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b8e472 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1870607944787712:12345-0@lo:1000: Request processed in 14839us (15003us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783950856.350470:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1783950856.351647:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1783950856.351660:0:7470:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783950856.351689:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c76545b8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7470:1870607944787712:0@lo:1000: 00100000:10000000:2.0:1783950856.352607:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783950856.352804:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783950856.353423:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783950856.354593:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783950856.356065:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783950856.359001:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783950856.359305:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783950856.359451:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783950856.359606:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783950856.359807:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783950856.359966:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783950856.360118:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783950856.360692:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783950856.360987:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783950856.361133:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783950856.361602:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783950856.361821:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000040:00080000:2.0:1783950856.363755:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1783950856.364480:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783950856.365554:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783950856.369929:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1783950856.377494:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783950856.377602:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783950856.377607:0:7479:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1783950856.385139:0:7454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783950856.385218:0:7454:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb8e801c6b988 00100000:10000000:3.0:1783950856.385227:0:7454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783950856.385921:0:7454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783950856.385966:0:7454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783950856.385988:0:7454:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783950856.386007:0:7454:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783950856.388364:0:7454:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783950856.388572:0:7454:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783950857.314539:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950858.339893:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950859.362790:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950860.389174:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783950860.832011:0:7725:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783950861.416323:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000764434fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944787840:0@lo:400: 00000100:00100000:2.0:1783950861.416398:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950861.418014:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950861.418082:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000067c419 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944788224:0@lo:400: 00000100:00100000:3.0:1783950861.418187:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950861.418994:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788224 00000100:00100000:1.0:1783950861.419004:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788224 00000100:00100000:1.0:1783950861.419070:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783950861.419079:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76545b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944788224:12345-0@lo:400: 00000100:00100000:1.0:1783950861.419185:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76545b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944788224:12345-0@lo:400: Request processed in 107us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950861.419192:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783950861.420280:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000067c419 x1870607944788224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950861.420298:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000067c419 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944788224:0@lo:400: 00000100:00100000:1.0:1783950861.420443:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ddf972e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944787968:0@lo:400: 00000100:00100000:1.0:1783950861.420492:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950861.420537:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950861.420544:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b00e0c7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944788096:0@lo:400: 00000100:00100000:1.0:1783950861.420609:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950861.420699:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944787968 00000100:00100000:3.0:1783950861.420705:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944787968 00000100:00100000:3.0:1783950861.420743:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783950861.420750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a50df9fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944787968:12345-0@lo:400: 00000100:00100000:3.0:1783950861.420797:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a50df9fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944787968:12345-0@lo:400: Request processed in 47us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950861.420804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783950861.420824:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788096 00000100:00100000:3.0:1783950861.420827:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788096 00000100:00100000:3.0:1783950861.420853:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950861.420858:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000763565f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944788096:12345-0@lo:400: 00000100:00100000:3.0:1783950861.420891:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000763565f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944788096:12345-0@lo:400: Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950861.420897:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950861.420924:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b00e0c7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944788096:0@lo:400: 00010000:00080000:3.0:1783950861.420934:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ddf972e2 x1870607944787968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950861.420954:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ddf972e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944787968:0@lo:400: 00000100:00100000:2.0:1783950861.421169:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5a3694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944788352:0@lo:41: 00000100:00100000:2.0:1783950861.421202:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950861.421236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944787840 00000100:00100000:2.0:1783950861.421240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944787840 00000100:00100000:2.0:1783950861.421270:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783950861.421277:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba77856a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+13:3655:x1870607944787840:12345-0@lo:400: 00000100:00100000:2.0:1783950861.421316:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba77856a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+13:3655:x1870607944787840:12345-0@lo:400: Request processed in 39us (4918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950861.421322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783950861.421396:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000764434fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944787840:0@lo:400: 00000100:00100000:3.0:1783950861.421797:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788352 00000100:00100000:3.0:1783950861.421801:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788352 00000100:00100000:3.0:1783950861.421834:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950861.421840:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097f6c1da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944788352:12345-0@lo:41: 00000004:00000024:3.0:1783950861.421866:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1783950861.421910:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097f6c1da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944788352:12345-0@lo:41: Request processed in 71us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950861.421916:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950861.421947:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5a3694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944788352:0@lo:41: 00000020:00000004:3.0:1783950861.966380:0:7777:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950861.966597:0:7777:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783950862.432681:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783950863.456280:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783950863.456288:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 4 10000000:01000000:2.0:1783950863.456293:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783950863.456350:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.456366:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.456396:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950863.456418:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb593e99 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788480:0@lo:101: 00000100:00100000:2.0:1783950863.456511:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950863.456598:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd104664 going to sleep for 11 seconds 00000100:00100000:0.0:1783950863.456852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788480 00000100:00100000:0.0:1783950863.456861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788480 00000100:00100000:0.0:1783950863.456932:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783950863.456943:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220659fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+13:6522:x1870607944788480:12345-0@lo:101: 00010000:00010000:0.0:1783950863.456956:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950863.456967:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7adfe62/0x7645c8e1169f7cce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7cc7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950863.456988:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7adfe62/0x7645c8e1169f7cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950863.456997:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7adfe62/0x7645c8e1169f7cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950863.457004:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7adfe62, rc 0) 00000100:00100000:0.0:1783950863.457045:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220659fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+14:6522:x1870607944788480:12345-0@lo:101: Request processed in 105us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950863.457051:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1783950863.457181:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950863.457744:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb593e99 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788480:0@lo:101: 00010000:00010000:3.0:1783950863.457761:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.457770:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950863.457829:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788608:0@lo:256: 00000100:00100000:3.0:1783950863.457865:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.457896:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000082449ce going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.457950:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788608 00000100:00100000:2.0:1783950863.457956:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788608 00000100:00100000:2.0:1783950863.457992:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783950863.457998:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a0fcb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:6522:x1870607944788608:12345-0@lo:256: 20000000:01000000:2.0:1783950863.458012:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783950863.458031:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783950863.458034:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783950863.458121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a0fcb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:6522:x1870607944788608:12345-0@lo:256: Request processed in 123us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.458129:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783950863.458262:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788608:0@lo:256: 10000000:01000000:3.0:1783950863.458303:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783950863.458309:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.458320:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000401f53f0/0x7645c8e1169f7cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950863.458331:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783950863.458332:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0343db6000 from 21 10000000:01000000:3.0:1783950863.458334:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783950863.458352:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.458357:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.458364:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950863.458373:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788736:0@lo:101: 00000100:00100000:3.0:1783950863.458396:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.458419:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000082449ce going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.458476:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788736 00000100:00100000:2.0:1783950863.458480:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788736 00000100:00100000:2.0:1783950863.458616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783950863.458624:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045775e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:6522:x1870607944788736:12345-0@lo:101: 00010000:00010000:2.0:1783950863.458632:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950863.458641:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7272059/0x7645c8e1169f7cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7cd5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.458654:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7272059/0x7645c8e1169f7cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.458674:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7272059/0x7645c8e1169f7cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.458686:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7272059, rc 0) 00000100:00100000:2.0:1783950863.458722:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045775e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944788736:12345-0@lo:101: Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.458728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783950863.458787:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788736:0@lo:101: 00010000:00010000:3.0:1783950863.458797:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.458805:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950863.458857:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788864:0@lo:501: 00000100:00100000:3.0:1783950863.458881:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.463937:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000082449ce going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.468536:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788864 00000100:00100000:1.0:1783950863.468551:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788864 00000100:00100000:1.0:1783950863.468618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783950863.468626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e5595cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944788864:12345-0@lo:501: 00000100:00100000:1.0:1783950863.468816:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e5595cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944788864:12345-0@lo:501: Request processed in 190us (9934us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.468824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783950863.469004:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788864:0@lo:501: 00000100:00100000:3.0:1783950863.469056:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788992:0@lo:503: 00000100:00100000:3.0:1783950863.469104:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.469138:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000082449ce going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.470252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944788992 00000100:00100000:1.0:1783950863.470261:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944788992 00000100:00100000:1.0:1783950863.470294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783950863.470300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d3b654d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944788992:12345-0@lo:503: 00000100:00100000:1.0:1783950863.470426:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d3b654d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944788992:12345-0@lo:503: Request processed in 125us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.470434:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950863.470546:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944788992:0@lo:503: 00000100:00100000:3.0:1783950863.470976:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7829:1870607944789120:0@lo:502: 00000100:00100000:3.0:1783950863.471018:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.471052:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000008540edc7 going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.471104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789120 00000100:00100000:1.0:1783950863.471109:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789120 00000100:00100000:1.0:1783950863.471129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783950863.471175:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027d0f6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:7829:x1870607944789120:12345-0@lo:502: 00000100:00100000:1.0:1783950863.471249:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027d0f6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:7829:x1870607944789120:12345-0@lo:502: Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.471256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783950863.471986:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7829:1870607944789120:0@lo:502: 00000100:00100000:3.0:1783950863.472040:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7829:1870607944789248:0@lo:502: 00000100:00100000:3.0:1783950863.472078:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.472112:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000008540edc7 going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.472173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789248 00000100:00100000:1.0:1783950863.472178:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789248 00000100:00100000:1.0:1783950863.472200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783950863.472205:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ec578f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:7829:x1870607944789248:12345-0@lo:502: 00000100:00100000:1.0:1783950863.472291:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ec578f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:7829:x1870607944789248:12345-0@lo:502: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.472298:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783950863.472435:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090b84510 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7829:1870607944789248:0@lo:502: 00000040:00080000:3.0:1783950863.472453:0:7829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783950863.473697:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783950863.473730:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783950863.473740:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.473752:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000253980ca/0x7645c8e1169f7cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950863.473762:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783950863.473764:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0343db6000 from 4 10000000:01000000:1.0:1783950863.473767:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783950863.473798:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.473805:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.473813:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950863.473843:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789376:0@lo:101: 00000100:00100000:1.0:1783950863.473894:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.473935:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.474209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789376 00000100:00100000:2.0:1783950863.474216:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789376 00000100:00100000:2.0:1783950863.474257:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783950863.474265:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b7f603a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944789376:12345-0@lo:101: 00010000:00010000:2.0:1783950863.474277:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950863.474290:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d7a21fd/0x7645c8e1169f7cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7ce3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.474312:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d7a21fd/0x7645c8e1169f7cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.474321:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d7a21fd/0x7645c8e1169f7cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.474329:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d7a21fd, rc 0) 00000100:00100000:2.0:1783950863.474371:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b7f603a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944789376:12345-0@lo:101: Request processed in 107us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.474377:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783950863.474455:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789376:0@lo:101: 00010000:00010000:1.0:1783950863.474469:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.474477:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950863.474535:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789504:0@lo:256: 00000100:00100000:1.0:1783950863.474564:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.474591:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.474708:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789504 00000100:00100000:2.0:1783950863.474713:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789504 00000100:00100000:2.0:1783950863.474729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783950863.474734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e1a0fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944789504:12345-0@lo:256: 20000000:01000000:2.0:1783950863.474746:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783950863.474768:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783950863.474772:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783950863.474853:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e1a0fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944789504:12345-0@lo:256: Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.474860:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783950863.476645:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789504:0@lo:256: 10000000:01000000:1.0:1783950863.476726:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783950863.476734:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.476745:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 0000000025845ddf/0x7645c8e1169f7ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950863.476755:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783950863.476757:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1783950863.476760:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783950863.476788:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.476807:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.476816:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950863.476833:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789632:0@lo:101: 00000100:00100000:1.0:1783950863.476884:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.476928:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.476995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789632 00000100:00100000:2.0:1783950863.477001:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789632 00000100:00100000:2.0:1783950863.477044:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783950863.477051:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029e040c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944789632:12345-0@lo:101: 00010000:00010000:2.0:1783950863.477063:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950863.477076:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7cf1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.477096:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.477106:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e1b4074/0x7645c8e1169f7cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950863.477114:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e1b4074, rc 0) 00000100:00100000:2.0:1783950863.477184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029e040c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944789632:12345-0@lo:101: Request processed in 133us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.477191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783950863.477307:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789632:0@lo:101: 00010000:00010000:1.0:1783950863.477319:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.477328:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950863.477380:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789760:0@lo:501: 00000100:00100000:1.0:1783950863.477403:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.477429:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.477478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789760 00000100:00100000:2.0:1783950863.477483:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789760 00000100:00100000:2.0:1783950863.477517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783950863.477522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ecbb7e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944789760:12345-0@lo:501: 00000100:00100000:2.0:1783950863.477639:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ecbb7e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944789760:12345-0@lo:501: Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.477667:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783950863.477815:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789760:0@lo:501: 00000100:00100000:1.0:1783950863.477842:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789888:0@lo:503: 00000100:00100000:1.0:1783950863.477877:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.477896:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d777b2b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.478598:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944789888 00000100:00100000:2.0:1783950863.478604:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944789888 00000100:00100000:2.0:1783950863.478640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783950863.478647:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cde580c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944789888:12345-0@lo:503: 00000100:00100000:2.0:1783950863.478833:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cde580c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944789888:12345-0@lo:503: Request processed in 186us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.478841:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783950863.482742:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944789888:0@lo:503: 00000100:00100000:2.0:1783950863.485846:0:7830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a95c9577 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7830:1870607944790016:0@lo:502: 00000100:00100000:2.0:1783950863.485931:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950863.485977:0:7830:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c57796a4 going to sleep for 11 seconds 00000100:00100000:3.0:1783950863.486030:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790016 00000100:00100000:3.0:1783950863.486038:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790016 00000100:00100000:3.0:1783950863.486085:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783950863.486092:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f70e5129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:7830:x1870607944790016:12345-0@lo:502: 00000100:00100000:3.0:1783950863.486249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f70e5129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:7830:x1870607944790016:12345-0@lo:502: Request processed in 157us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950863.486257:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783950863.486411:0:7830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a95c9577 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7830:1870607944790016:0@lo:502: 00000020:01000000:0.0:1783950863.486438:0:7830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950863.486447:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950863.486450:0:7830:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783950863.486454:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783950863.486458:0:7830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:0.0:1783950863.486488:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783950863.486513:0:7830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b7ac813b) 00000020:00000080:0.0:1783950863.486535:0:7830:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1783950863.486540:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783950863.486634:0:7830:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783950863.486641:0:7830:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783950863.486648:0:7830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7d06 00010000:00080000:0.0:1783950863.486685:0:7830:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000880ef75@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783950863.488271:0:7830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1783950863.489950:0:7830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783950863.489965:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783950863.490008:0:7830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783950863.490030:0:7830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7d0d 00000100:00080000:0.0:1783950863.490041:0:7830:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783950863.490046:0:7830:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000000880ef75 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783950863.490079:0:7830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000999fd5be x1870607944790144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783950863.490106:0:7830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783950863.490285:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944790272:0@lo:400: 00000100:00100000:1.0:1783950863.490356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.490391:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950863.490397:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5a3694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944790400:0@lo:400: 00000100:00100000:1.0:1783950863.490424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.490457:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944790528:0@lo:400: 00000100:00100000:1.0:1783950863.490479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.490524:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790272 00000100:00100000:1.0:1783950863.490530:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790272 00000100:00100000:1.0:1783950863.490567:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790528 00000100:00100000:1.0:1783950863.490570:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790528 00000100:00100000:1.0:1783950863.490586:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783950863.490592:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b378bd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944790272:12345-0@lo:400: 00000100:00100000:1.0:1783950863.490644:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b378bd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944790272:12345-0@lo:400: Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.490651:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783950863.490677:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783950863.490683:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041014ef8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944790528:12345-0@lo:400: 00000100:00100000:1.0:1783950863.490715:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041014ef8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944790528:12345-0@lo:400: Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.490720:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783950863.490736:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790400 00000100:00100000:1.0:1783950863.490740:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790400 00000100:00100000:1.0:1783950863.490764:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783950863.490769:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6b33eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944790400:12345-0@lo:400: 00000100:00100000:1.0:1783950863.490796:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6b33eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944790400:12345-0@lo:400: Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.490801:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783950863.490848:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bb2efe3c x1870607944790528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950863.490861:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944790528:0@lo:400: 00000100:00100000:1.0:1783950863.490887:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5a3694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944790400:0@lo:400: 00010000:00080000:1.0:1783950863.490897:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007f13e39f x1870607944790272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950863.490905:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944790272:0@lo:400: 00000100:00100000:3.0:1783950863.491061:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000999fd5be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944790144:0@lo:38: 00000100:00100000:3.0:1783950863.491095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1783950863.491193:0:7830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:3.0:1783950863.491602:0:7830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950863.491614:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950863.491617:0:7830:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783950863.491621:0:7830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783950863.491624:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950863.491625:0:7830:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783950863.491628:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783950863.491629:0:7830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783950863.491654:0:7830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004db97475 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7830:1870607944790656:0@lo:502: 00000100:00100000:3.0:1783950863.491709:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.491737:0:7830:0:(client.c:2702:ptlrpc_set_wait()) set 0000000067d281ff going to sleep for 11 seconds 00000100:00100000:0.0:1783950863.491775:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790656 00000100:00100000:0.0:1783950863.491779:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790656 00000100:00100000:0.0:1783950863.491815:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950863.491821:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a94e1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:7830:x1870607944790656:12345-0@lo:502: 00000100:00100000:0.0:1783950863.491922:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a94e1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:7830:x1870607944790656:12345-0@lo:502: Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950863.491929:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1783950863.492000:0:7833:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000034c9752c x1870607944790784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950863.492019:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b8167fa4 going to sleep for 0 seconds 00000100:00100000:3.0:1783950863.492083:0:7830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004db97475 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:7830:1870607944790656:0@lo:502: 00000020:01000000:3.0:1783950863.492104:0:7830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950863.492109:0:7830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950863.492111:0:7830:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783950863.492114:0:7830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1783950863.492300:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790144 00000100:00100000:1.0:1783950863.492305:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790144 00000100:00100000:1.0:1783950863.492332:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783950863.492337:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090b84510 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607944790144:12345-0@lo:38: 00010000:00080000:1.0:1783950863.492357:0:6531:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1783950863.492389:0:6531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7d14 00000004:00100000:1.0:1783950863.492402:0:6531:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783950863.492408:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1783950863.492599:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1783950863.492622:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783950863.492630:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950863.492640:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 00000000d3f36ab7/0x7645c8e1169f7cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950863.492649:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783950863.492651:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e036d35b380 from 1 10000000:01000000:0.0:1783950863.492653:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783950863.492684:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950863.492691:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950863.492699:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950863.492710:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083cb76b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944790912:0@lo:101: 00000100:00100000:0.0:1783950863.492742:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950863.492774:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 00000000570c61ac going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.492826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790912 00000100:00100000:1.0:1783950863.492830:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790912 00000100:00100000:1.0:1783950863.492861:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783950863.492866:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c55cd47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944790912:12345-0@lo:101: 00010000:00010000:1.0:1783950863.492875:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950863.492886:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e195d8d0/0x7645c8e1169f7d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7d1b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.492905:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e195d8d0/0x7645c8e1169f7d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.492926:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e195d8d0/0x7645c8e1169f7d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950863.492935:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e195d8d0, rc 0) 00000100:00100000:1.0:1783950863.493009:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c55cd47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944790912:12345-0@lo:101: Request processed in 142us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.493015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783950863.495405:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083cb76b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944790912:0@lo:101: 00010000:00010000:3.0:1783950863.495432:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.495444:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950863.495650:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004db97475 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944791040:0@lo:501: 00000100:00100000:3.0:1783950863.495711:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.495755:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 0000000067d281ff going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.495827:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791040 00000100:00100000:2.0:1783950863.495833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791040 00000100:00100000:2.0:1783950863.495881:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783950863.495890:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000845dd4ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944791040:12345-0@lo:501: 00000100:00100000:2.0:1783950863.495981:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000845dd4ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944791040:12345-0@lo:501: Request processed in 93us (270us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783950863.495989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783950863.496104:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004db97475 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944791040:0@lo:501: 10000000:01000000:3.0:1783950863.496132:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783950863.496138:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950863.496191:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: 0000000097664742/0x7645c8e1169f7d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783950863.516874:0:6531:0:(import.c:65:import_set_state_nolock()) 000000002799d5c5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783950863.517029:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090b84510 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607944790144:12345-0@lo:38: Request processed in 24689us (25932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.517038:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783950863.521012:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783950863.521032:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783950863.521043:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783950863.521049:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783950863.521052:0:3651:0:(import.c:65:import_set_state_nolock()) 000000000880ef75 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783950863.521272:0:3651:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b8167fa4): req@0000000034c9752c x1870607944790784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950863.521295:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000999fd5be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944790144:0@lo:38: 00000100:00100000:3.0:1783950863.521441:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.521513:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b8167fa4 going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.521670:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944790784 00000100:00100000:1.0:1783950863.521677:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944790784 00000100:00100000:1.0:1783950863.521727:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783950863.521735:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004db97475 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944790784:12345-0@lo:1000: 00000100:00100000:1.0:1783950863.521831:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004db97475 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944790784:12345-0@lo:1000: Request processed in 97us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.521839:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783950863.521942:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034c9752c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944790784:0@lo:1000: 00000040:01000000:3.0:1783950863.521980:0:7833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783950863.522020:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791168:0@lo:1000: 00000100:00100000:3.0:1783950863.522049:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.522071:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 000000006303230d going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.522273:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791168 00000100:00100000:1.0:1783950863.522278:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791168 00000100:00100000:1.0:1783950863.522343:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783950863.522350:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000014d396c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791168:12345-0@lo:1000: 00000100:00100000:1.0:1783950863.522462:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000014d396c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791168:12345-0@lo:1000: Request processed in 113us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.522468:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783950863.522532:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791168:0@lo:1000: 00000100:00100000:3.0:1783950863.522570:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791296:0@lo:700: 00000100:00100000:3.0:1783950863.522597:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.522623:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791296 00000100:00100000:3.0:1783950863.522626:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791296 00000100:00100000:3.0:1783950863.522651:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783950863.522667:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c91ffd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791296:12345-0@lo:700: 00000100:00100000:3.0:1783950863.522701:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c91ffd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791296:12345-0@lo:700: Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950863.522706:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783950863.522721:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 0000000067d281ff going to sleep for 11 seconds 00000100:00100000:3.0:1783950863.522732:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791296:0@lo:700: 00000100:00100000:3.0:1783950863.522892:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791424:0@lo:1000: 00000100:00100000:3.0:1783950863.522917:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950863.534231:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d09a0e74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944791552:0@lo:41: 00000100:00100000:0.0:1783950863.534331:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950863.534364:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ccd9f7bb going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.535073:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791424 00000100:00100000:2.0:1783950863.535083:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791424 00000100:00100000:2.0:1783950863.536338:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783950863.536350:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fcf2fc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791424:12345-0@lo:1000: 00000100:00100000:2.0:1783950863.536519:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fcf2fc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791424:12345-0@lo:1000: Request processed in 172us (13600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.536527:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783950863.538074:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791424:0@lo:1000: 00000004:00080000:3.0:1783950863.538265:0:7833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000067d281ff with version 0 00000020:00100000:3.0:1783950863.538292:0:7833:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783950863.538299:0:7833:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cc07fc7c x1870607944791808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783950863.538318:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791808:0@lo:1000: 00000100:00100000:3.0:1783950863.542005:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950863.553418:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 0000000004b3d675 going to sleep for 11 seconds 00000100:00100000:2.0:1783950863.565740:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791552 00000100:00100000:2.0:1783950863.565757:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791552 00000100:00100000:2.0:1783950863.565814:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791808 00000100:00100000:2.0:1783950863.565818:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791808 00000100:00100000:2.0:1783950863.565837:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783950863.565846:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe74d2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944791552:12345-0@lo:41: 00000004:00000024:2.0:1783950863.565888:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783950863.566062:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe74d2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944791552:12345-0@lo:41: Request processed in 216us (31729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950863.566070:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783950863.566086:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783950863.566092:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed493744 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1870607944791808:12345-0@lo:1000: 00000001:00080000:2.0:1783950863.570999:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1783950863.571013:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783950863.571308:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed493744 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7833:x1870607944791808:12345-0@lo:1000: Request processed in 5213us (29306us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783950863.571334:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1783950863.571618:0:7833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1783950863.571623:0:7833:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783950863.571638:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cc07fc7c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791808:0@lo:1000: 00000100:00100000:2.0:1783950863.571743:0:7833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000da6028b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791936:0@lo:1000: 00000100:00100000:2.0:1783950863.571786:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950863.571834:0:7833:0:(client.c:2702:ptlrpc_set_wait()) set 00000000025ebc97 going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.572079:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944791936 00000100:00100000:1.0:1783950863.572086:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944791936 00000100:00100000:1.0:1783950863.572227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783950863.572235:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3709d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7833:x1870607944791936:12345-0@lo:1000: 00000100:00100000:1.0:1783950863.572315:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3709d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7833:x1870607944791936:12345-0@lo:1000: Request processed in 81us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950863.572322:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783950863.572478:0:7833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000da6028b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1870607944791936:0@lo:1000: 00000040:00080000:2.0:1783950863.572572:0:7833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1783950863.572608:0:7833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000a360585b with version 1 00000004:00080000:1.0:1783950863.573573:0:7831:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009daea2f4 version 1 rpc_version 1 00000020:00100000:1.0:1783950863.573602:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783950863.573611:0:7831:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007f13e39f x1870607944792192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783950863.573631:0:7831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1870607944792192:0@lo:1000: 00000100:00100000:1.0:1783950863.573708:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950863.573735:0:7831:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec0d1ab2 going to sleep for 11 seconds 00000100:00100000:1.0:1783950863.573755:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792192 00000100:00100000:1.0:1783950863.573761:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792192 00000100:00100000:1.0:1783950863.573791:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783950863.573798:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5a3694 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1870607944792192:12345-0@lo:1000: 00000100:00100000:0.0:1783950863.578373:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d09a0e74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944791552:0@lo:41: 00000001:00080000:1.0:1783950863.578591:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1783950863.578773:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5a3694 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1870607944792192:12345-0@lo:1000: Request processed in 4974us (5064us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783950863.578783:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1783950863.578865:0:7831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783950863.578869:0:7831:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783950863.578882:0:7831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1870607944792192:0@lo:1000: 00000040:00080000:2.0:1783950863.582079:0:7833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783950863.582853:0:7833:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783950863.582860:0:7833:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1783950864.480317:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783950865.140654:0:7884:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950865.140907:0:7884:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783950865.504328:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783950866.077089:0:7932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5d142120 20000000:00000080:0.0:1783950866.077107:0:7932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e037d0a5400 uarg=0000000000000000 20000000:01000000:0.0:1783950866.077233:0:7932:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783950866.077240:0:7932:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783950866.077246:0:7932:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783950866.077329:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1783950866.077340:0:7932:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1783950866.085739:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783950866.086011:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783950866.086050:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1783950866.086070:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1783950866.086088:0:7932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783950866.086112:0:7932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.086134:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.086171:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.086180:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.086219:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.086231:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 17 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950866.086244:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1870607944792320:0@lo:104: 00000100:00100000:1.0:1783950866.086307:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950866.086373:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.086381:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 17 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950866.086388:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1870607944792448:0@lo:104: 00000100:00100000:1.0:1783950866.086407:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set 000000007013dbe5 going to sleep for 11 seconds 00000100:00100000:3.0:1783950866.086675:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783950866.086695:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950866.086720:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792320 00000100:00100000:3.0:1783950866.086727:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792320 00000100:00100000:3.0:1783950866.086770:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792448 00000100:00100000:3.0:1783950866.086774:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792448 00000100:00100000:3.0:1783950866.086787:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950866.086793:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e62e631d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:7932:x1870607944792320:12345-0@lo:104: 00010000:00010000:3.0:1783950866.086815:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.086869:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783950866.086874:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e62e631d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:7932:x1870607944792320:12345-0@lo:104: Request processed in 82us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950866.086881:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950866.086922:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950866.086928:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca2951f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+3:7932:x1870607944792448:12345-0@lo:104: 00010000:00010000:3.0:1783950866.086935:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.086975:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783950866.086980:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca2951f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+3:7932:x1870607944792448:12345-0@lo:104: Request processed in 53us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950866.086985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783950866.087001:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783950866.087006:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087012:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bac82027 already unused, calling callback (000000006bf39712) 10000000:00010000:3.0:1783950866.087015:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087022:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950866.087028:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950866.087034:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783950866.087063:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087070:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950866.087088:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087095:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 00000000bac82027/0x7645c8e1169f7c8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c96 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087119:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783950866.087121:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087126:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c54629c already unused, calling callback (000000006bf39712) 10000000:00010000:3.0:1783950866.087128:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087134:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950866.087139:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950866.087181:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783950866.087196:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087202:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950866.087206:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087212:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: 000000003c54629c/0x7645c8e1169f7ba1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ba8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087225:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950866.087226:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950866.087228:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950866.087234:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950866.087258:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944792576:0@lo:103: 00000100:00100000:3.0:1783950866.087286:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950866.087314:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950866.087319:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ffda474 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944792704:0@lo:103: 00000100:00100000:3.0:1783950866.087340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950866.087382:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792576 00000100:00100000:3.0:1783950866.087386:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792576 00010000:00010000:3.0:1783950866.087404:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 18 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950866.087422:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792704 00000100:00100000:3.0:1783950866.087425:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792704 00010000:00010000:3.0:1783950866.087435:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 19 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950866.087448:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950866.087454:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e11742b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+19:3652:x1870607944792576:12345-0@lo:103: 00010000:00010000:3.0:1783950866.087463:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950866.087467:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 19 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087550:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 19 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087568:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950866.087598:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e11742b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+19:3652:x1870607944792576:12345-0@lo:103: Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950866.087604:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950866.087617:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950866.087622:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc07fc7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+18:3652:x1870607944792704:12345-0@lo:103: 00010000:00010000:3.0:1783950866.087649:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950866.087653:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 18 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087662:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 18 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087672:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087679:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087691:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087698:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087704:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087710:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087715:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000000ba7010 already unused, calling callback (00000000ec34550f) 00010000:00010000:3.0:1783950866.087718:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087724:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087743:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.087753:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950866.087777:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc07fc7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+18:3652:x1870607944792704:12345-0@lo:103: Request processed in 156us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950866.087783:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950866.087819:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ffda474 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944792704:0@lo:103: 00000100:00100000:3.0:1783950866.087828:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944792576:0@lo:103: 00010000:00010000:1.0:1783950866.088624:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a175950/0x7645c8e1169f7c96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7c8f expref: 17 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950866.088650:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f13e39f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1870607944792320:0@lo:104: 00010000:00010000:1.0:1783950866.088661:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002fd0619c/0x7645c8e1169f7ba8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7ba1 expref: 16 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950866.088669:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1870607944792448:0@lo:104: 00010000:00010000:1.0:1783950866.088684:0:7932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.088692:0:7932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.088698:0:7932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950866.088703:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000ba7010/0x7645c8e1169f7d29 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950866.528420:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950866.529034:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783950866.529057:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944792832:0@lo:41: 00000100:00100000:0.0:1783950866.529125:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950866.529418:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792832 00000100:00100000:3.0:1783950866.529426:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792832 00000100:00100000:3.0:1783950866.529525:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783950866.529534:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d09a0e74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944792832:12345-0@lo:41: 00000004:00000024:3.0:1783950866.529568:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1783950866.529615:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d09a0e74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944792832:12345-0@lo:41: Request processed in 82us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950866.529622:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783950866.529700:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb2efe3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944792832:0@lo:41: 00010000:00010000:0.0:1783950867.561099:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950868.577022:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1783950868.577541:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950868.577723:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944793088:0@lo:400: 00000100:00100000:0.0:1783950868.577809:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950868.577868:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950868.577874:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ffda474 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944793216:0@lo:400: 00000100:00100000:0.0:1783950868.577900:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950868.577933:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793088 00000100:00100000:0.0:1783950868.577940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793088 00000100:00100000:0.0:1783950868.577988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783950868.577996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7dab1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:3652:x1870607944793088:12345-0@lo:400: 00000100:00100000:0.0:1783950868.578045:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7dab1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:3652:x1870607944793088:12345-0@lo:400: Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950868.578053:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783950868.578097:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793216 00000100:00100000:0.0:1783950868.578108:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793216 00000100:00100000:0.0:1783950868.578177:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783950868.578183:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4a98d27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944793216:12345-0@lo:400: 00000100:00100000:0.0:1783950868.578214:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4a98d27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944793216:12345-0@lo:400: Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950868.578220:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783950868.578261:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004ffda474 x1870607944793216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950868.578274:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ffda474 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944793216:0@lo:400: 00000100:00100000:0.0:1783950868.578283:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000874bac20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944793088:0@lo:400: 00000100:00100000:2.0:1783950868.579698:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7308472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944793344:0@lo:400: 00000100:00100000:2.0:1783950868.579759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950868.579788:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944792960:0@lo:41: 00000100:00100000:2.0:1783950868.579879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950868.580190:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783950868.580197:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944793472:0@lo:400: 00000100:00100000:2.0:1783950868.580224:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950868.580557:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793472 00000100:00100000:3.0:1783950868.580564:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793472 00000100:00100000:3.0:1783950868.580626:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950868.580634:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a24f3e1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944793472:12345-0@lo:400: 00000100:00100000:3.0:1783950868.580682:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a24f3e1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944793472:12345-0@lo:400: Request processed in 50us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950868.580689:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783950868.580721:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009cd73d5c x1870607944793472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950868.580745:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944793472:0@lo:400: 00000100:00100000:1.0:1783950868.590059:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793344 00000100:00100000:1.0:1783950868.590073:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793344 00000100:00100000:1.0:1783950868.590131:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950868.590171:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6b6f638 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944793600:0@lo:400: 00000100:00100000:1.0:1783950868.590252:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950868.590317:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944792960 00000100:00100000:1.0:1783950868.590331:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944792960 00000100:00100000:1.0:1783950868.590346:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793600 00000100:00100000:1.0:1783950868.590348:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793600 00000100:00100000:1.0:1783950868.590381:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783950868.590389:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da6028b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944793344:12345-0@lo:400: 00000100:00100000:1.0:1783950868.591099:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da6028b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944793344:12345-0@lo:400: Request processed in 708us (11336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950868.591122:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783950868.591169:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783950868.591177:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4cf1484 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944792960:12345-0@lo:41: 00000004:00000024:1.0:1783950868.591207:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783950868.591243:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4cf1484 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944792960:12345-0@lo:41: Request processed in 70us (11364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950868.591249:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783950868.591260:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783950868.591265:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb2efe3c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944793600:12345-0@lo:400: 00000100:00100000:1.0:1783950868.591296:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb2efe3c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944793600:12345-0@lo:400: Request processed in 31us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950868.591302:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783950868.591538:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6b6f638 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944793600:0@lo:400: 00000100:00100000:2.0:1783950868.591906:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7308472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944793344:0@lo:400: 00000100:00100000:2.0:1783950868.591923:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088bf2888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944792960:0@lo:41: 10000000:01000000:3.0:1783950869.282974:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783950869.282982:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 1 10000000:01000000:3.0:1783950869.282987:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783950869.283031:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: 00000000a640647e/0x7645c8e1169f7d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950869.283043:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: 00000000a640647e/0x7645c8e1169f7d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950869.283054:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: 00000000a640647e/0x7645c8e1169f7d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950869.283077:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944793728:0@lo:101: 00000100:00100000:3.0:1783950869.283170:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950869.283221:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 000000002020d8e7 going to sleep for 11 seconds 00000100:00100000:1.0:1783950869.283309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793728 00000100:00100000:1.0:1783950869.283317:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793728 00000100:00100000:1.0:1783950869.283373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783950869.283382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944793728:12345-0@lo:101: 00010000:00010000:1.0:1783950869.283395:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950869.283409:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c54629c/0x7645c8e1169f7d37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7d30 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.283430:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c54629c/0x7645c8e1169f7d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.283449:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c54629c/0x7645c8e1169f7d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.283458:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c54629c, rc 0) 00000100:00100000:1.0:1783950869.283497:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944793728:12345-0@lo:101: Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950869.283503:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783950869.286910:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944793728:0@lo:101: 00010000:00010000:3.0:1783950869.286939:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: 00000000a640647e/0x7645c8e1169f7d30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950869.286952:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: 00000000a640647e/0x7645c8e1169f7d30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950869.287043:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944793856:0@lo:501: 00000100:00100000:3.0:1783950869.287102:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950869.287133:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 000000002020d8e7 going to sleep for 11 seconds 00000100:00100000:3.0:1783950869.287169:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793856 00000100:00100000:3.0:1783950869.287174:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793856 00000100:00100000:3.0:1783950869.287226:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783950869.287234:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000483c404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944793856:12345-0@lo:501: 00000100:00100000:3.0:1783950869.287731:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000483c404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944793856:12345-0@lo:501: Request processed in 496us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950869.287741:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783950869.287802:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944793856:0@lo:501: 00000100:00100000:3.0:1783950869.287833:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944793984:0@lo:503: 00000100:00100000:3.0:1783950869.287875:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950869.287889:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set 000000002020d8e7 going to sleep for 11 seconds 00000100:00100000:3.0:1783950869.287902:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944793984 00000100:00100000:3.0:1783950869.287906:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944793984 00000100:00100000:3.0:1783950869.287929:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783950869.287934:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e843c9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944793984:12345-0@lo:503: 00000100:00100000:3.0:1783950869.288012:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e843c9fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944793984:12345-0@lo:503: Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950869.288018:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783950869.288054:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cd73d5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944793984:0@lo:503: 00000100:00100000:2.0:1783950869.315240:0:8044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009330d1be pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8044:1870607944794112:0@lo:502: 00000100:00100000:2.0:1783950869.315336:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950869.315369:0:8044:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015d56880 going to sleep for 11 seconds 00000100:00100000:3.0:1783950869.316741:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794112 00000100:00100000:3.0:1783950869.316754:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794112 00000100:00100000:3.0:1783950869.316816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783950869.316826:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc8f035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:8044:x1870607944794112:12345-0@lo:502: 00000100:00100000:3.0:1783950869.316994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc8f035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:8044:x1870607944794112:12345-0@lo:502: Request processed in 169us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950869.317002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783950869.322955:0:8044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009330d1be pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8044:1870607944794112:0@lo:502: 00000020:01000000:2.0:1783950869.323005:0:8044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950869.323014:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950869.323017:0:8044:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783950869.323025:0:8044:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0377b14000 00000020:00000080:2.0:1783950869.323027:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783950869.323096:0:8044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8044:1870607944794240:0@lo:502: 00000100:00100000:2.0:1783950869.323191:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950869.323230:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794240 00000100:00100000:2.0:1783950869.323237:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794240 00000100:00100000:2.0:1783950869.323288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783950869.323297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:8044:x1870607944794240:12345-0@lo:502: 00000100:00100000:2.0:1783950869.323422:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:8044:x1870607944794240:12345-0@lo:502: Request processed in 125us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950869.323430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783950869.327405:0:8044:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950869.327464:0:8044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8044:1870607944794240:0@lo:502: 00000020:01000000:3.0:1783950869.327510:0:8044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950869.327518:0:8044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950869.327521:0:8044:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783950869.327524:0:8044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783950869.328565:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783950869.328594:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783950869.328681:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.328693:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950869.328703:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783950869.328706:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db6000 from 1 10000000:01000000:1.0:1783950869.328709:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783950869.328741:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.328749:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.328759:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950869.329033:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944794368:0@lo:101: 00000100:00100000:1.0:1783950869.329189:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950869.329232:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034328b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950869.329597:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794368 00000100:00100000:3.0:1783950869.329859:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794368 00000100:00100000:3.0:1783950869.329918:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783950869.329928:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944794368:12345-0@lo:101: 00010000:00010000:3.0:1783950869.329943:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950869.330031:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7d3e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950869.330060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950869.330184:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950869.330195:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3e00, rc 0) 00000100:00100000:3.0:1783950869.330249:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944794368:12345-0@lo:101: Request processed in 322us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950869.330527:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783950869.330717:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944794368:0@lo:101: 00010000:00010000:1.0:1783950869.330734:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.330744:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950869.331206:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944794496:0@lo:501: 00000100:00100000:1.0:1783950869.331249:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950869.331285:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034328b600 going to sleep for 11 seconds 00000100:00100000:2.0:1783950869.331367:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794496 00000100:00100000:2.0:1783950869.331373:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794496 00000100:00100000:2.0:1783950869.331407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783950869.331415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944794496:12345-0@lo:501: 00000100:00100000:2.0:1783950869.332278:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944794496:12345-0@lo:501: Request processed in 861us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950869.332287:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783950869.332332:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944794496:0@lo:501: 00000100:00100000:2.0:1783950869.332366:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944794624:0@lo:503: 00000100:00100000:2.0:1783950869.332408:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950869.332431:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783950869.332444:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794624 00000100:00100000:2.0:1783950869.334054:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794624 00000100:00100000:2.0:1783950869.334752:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783950869.334764:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944794624:12345-0@lo:503: 00000100:00100000:2.0:1783950869.334922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944794624:12345-0@lo:503: Request processed in 161us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950869.334940:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783950869.336221:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944794624:0@lo:503: 00000100:00100000:2.0:1783950869.339762:0:8047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8047:1870607944794752:0@lo:502: 00000100:00100000:2.0:1783950869.339837:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950869.339878:0:8047:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783950869.339925:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794752 00000100:00100000:3.0:1783950869.339932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794752 00000100:00100000:3.0:1783950869.339976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783950869.339984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:8047:x1870607944794752:12345-0@lo:502: 00000100:00100000:3.0:1783950869.340104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:8047:x1870607944794752:12345-0@lo:502: Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950869.340111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783950869.340324:0:8047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8047:1870607944794752:0@lo:502: 00000020:01000000:1.0:1783950869.340351:0:8047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783950869.340360:0:8047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950869.340362:0:8047:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783950869.340369:0:8047:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0343db6000 00000020:00000080:1.0:1783950869.340371:0:8047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783950869.340394:0:8047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8047:1870607944794880:0@lo:502: 00000100:00100000:1.0:1783950869.340428:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950869.340535:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944794880 00000100:00100000:2.0:1783950869.340540:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944794880 00000100:00100000:2.0:1783950869.340573:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783950869.340581:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:8047:x1870607944794880:12345-0@lo:502: 00000100:00100000:2.0:1783950869.344395:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:8047:x1870607944794880:12345-0@lo:502: Request processed in 3804us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950869.344411:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783950869.344742:0:8047:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034328bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783950869.344769:0:8047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8047:1870607944794880:0@lo:502: 00000020:01000000:1.0:1783950869.344805:0:8047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783950869.344813:0:8047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950869.344815:0:8047:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783950869.344819:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783950869.344999:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783950869.345020:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783950869.345031:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950869.345042:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950869.603485:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950870.625701:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950871.648399:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950871.648460:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950871.648483:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944795008:0@lo:41: 00000100:00100000:0.0:1783950871.648551:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950871.648666:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795008 00000100:00100000:1.0:1783950871.648675:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795008 00000100:00100000:1.0:1783950871.648729:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783950871.648740:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944795008:12345-0@lo:41: 00000004:00000024:1.0:1783950871.648776:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783950871.648827:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944795008:12345-0@lo:41: Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950871.648835:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783950871.648922:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944795008:0@lo:41: 00010000:00010000:2.0:1783950872.675908:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950873.703197:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950873.703342:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783950873.703364:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944795136:0@lo:41: 00000100:00100000:1.0:1783950873.703431:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950873.703491:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795136 00000100:00100000:1.0:1783950873.703498:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795136 00000100:00100000:1.0:1783950873.703544:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783950873.703553:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944795136:12345-0@lo:41: 00000004:00000024:1.0:1783950873.703601:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783950873.703648:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944795136:12345-0@lo:41: Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950873.703654:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783950873.703791:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944795136:0@lo:41: 00000100:00100000:1.0:1783950873.704851:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944795392:0@lo:400: 00000100:00100000:1.0:1783950873.704916:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950873.704951:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950873.704957:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944795520:0@lo:400: 00000100:00100000:1.0:1783950873.704981:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950873.705012:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795392 00000100:00100000:1.0:1783950873.705023:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795392 00000100:00100000:1.0:1783950873.705068:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783950873.705076:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944795392:12345-0@lo:400: 00000100:00100000:1.0:1783950873.705123:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944795392:12345-0@lo:400: Request processed in 47us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950873.705129:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783950873.705180:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944795648:0@lo:400: 00000100:00100000:1.0:1783950873.705205:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950873.705224:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783950873.705229:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944795264:0@lo:400: 00000100:00100000:1.0:1783950873.705251:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950873.706379:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795520 00000100:00100000:2.0:1783950873.706389:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795520 00000100:00100000:2.0:1783950873.706427:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783950873.706436:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944795520:12345-0@lo:400: 00000100:00100000:2.0:1783950873.706495:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944795520:12345-0@lo:400: Request processed in 59us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950873.706508:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783950873.706818:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795648 00000100:00100000:1.0:1783950873.706823:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795648 00000100:00100000:1.0:1783950873.706852:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783950873.706858:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944795648:12345-0@lo:400: 00000100:00100000:1.0:1783950873.706896:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944795648:12345-0@lo:400: Request processed in 38us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950873.706902:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783950873.706946:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944795520:0@lo:400: 00010000:00080000:1.0:1783950873.706961:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e03489c7800 x1870607944795392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950873.706971:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944795392:0@lo:400: 00010000:00080000:1.0:1783950873.707000:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e03489c6a00 x1870607944795648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950873.707010:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944795648:0@lo:400: 00000100:00100000:2.0:1783950873.709008:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795264 00000100:00100000:2.0:1783950873.709022:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795264 00000100:00100000:2.0:1783950873.709074:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783950873.709083:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:3654:x1870607944795264:12345-0@lo:400: 00000100:00100000:2.0:1783950873.709177:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:3654:x1870607944795264:12345-0@lo:400: Request processed in 95us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950873.709184:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783950873.709335:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944795264:0@lo:400: 00010000:00010000:2.0:1783950874.731425:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950875.745267:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950876.769569:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950876.770756:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950876.770780:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944795776:0@lo:41: 00000100:00100000:3.0:1783950876.770851:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950876.770971:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795776 00000100:00100000:0.0:1783950876.770979:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795776 00000100:00100000:0.0:1783950876.771072:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783950876.771083:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944795776:12345-0@lo:41: 00000004:00000024:0.0:1783950876.771120:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1783950876.771196:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944795776:12345-0@lo:41: Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950876.771204:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783950876.775732:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944795776:0@lo:41: 00010000:00010000:2.0:1783950877.794344:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783950878.068306:0:8432:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783950878.068312:0:8432:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783950878.068313:0:8432:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783950878.069851:0:8432:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0377952800 00000020:01000004:1.0:1783950878.069883:0:8432:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783950878.069902:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783950878.069924:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e037d320000) 00000020:00000080:1.0:1783950878.069948:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783950878.102673:0:8432:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783950878.102735:0:8432:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1783950878.135018:0:8432:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783950878.135262:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783950878.135274:0:8432:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783950878.135286:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7645c8e1169f7d53 00000020:01000004:1.0:1783950878.135293:0:8432:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783950878.135314:0:8432:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783950878.135317:0:8432:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783950878.135322:0:8432:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783950878.135327:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783950878.135338:0:8432:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e037d3219c0) 00000020:00000080:1.0:1783950878.135348:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1783950878.136819:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950878.136990:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783950878.136996:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783950878.139061:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783950878.139070:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783950878.139730:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783950878.139739:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783950878.143256:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783950878.145353:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783950878.145363:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783950878.151008:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783950878.151021:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783950878.198073:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783950878.198339:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783950878.198346:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783950878.204882:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783950878.204896:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783950878.206556:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783950878.206570:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783950878.211586:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783950878.211760:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783950878.211766:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783950878.212660:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783950878.212668:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783950878.277474:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783950878.277688:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783950878.277695:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783950878.281016:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783950878.281028:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783950878.284411:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783950878.284444:0:8432:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1783950878.284450:0:8432:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783950878.335947:0:8432:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783950878.335992:0:8432:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783950878.335997:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783950878.335999:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783950878.336000:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950878.336001:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950878.336002:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950878.336003:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950878.336005:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783950878.336006:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950878.336007:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950878.336009:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950878.336010:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783950878.336013:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783950878.336015:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783950878.336016:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783950878.336017:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950878.336018:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950878.336019:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950878.336020:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950878.336024:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783950878.336025:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950878.336026:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950878.336027:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950878.336028:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783950878.336054:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783950878.336071:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944795904:0@lo:253: 00000100:00100000:2.0:1783950878.336228:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.336377:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944795904 00000100:00100000:3.0:1783950878.336385:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944795904 00000100:00100000:3.0:1783950878.336445:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783950878.336456:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:8432:x1870607944795904:12345-0@lo:253: 20000000:01000000:3.0:1783950878.336501:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783950878.336504:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1783950878.336508:0:6519:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1783950878.336511:0:6519:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:2.0:1783950878.336742:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647a80 going to sleep for 11 seconds 00000040:00080000:3.0:1783950878.336903:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783950878.337040:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1783950878.337058:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783950878.337078:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1783950878.337084:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783950878.337099:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1783950878.337120:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1783950878.337682:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1783950878.337703:0:6519:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.133@tcp 20000000:01000000:3.0:1783950878.337705:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:3.0:1783950878.337736:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1783950878.337744:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783950878.337759:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1783950878.337764:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:3.0:1783950878.337777:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1783950878.337784:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783950878.337797:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1783950878.337833:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1783950878.337908:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1783950878.337920:0:6519:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.133@tcp 20000000:01000000:3.0:1783950878.337922:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:3.0:1783950878.337937:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1783950878.337942:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783950878.337955:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1783950878.337960:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:3.0:1783950878.337973:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1783950878.337979:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783950878.337992:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1783950878.338008:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1783950878.338678:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1783950878.338693:0:6519:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.133@tcp 20000000:01000000:3.0:1783950878.338695:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:3.0:1783950878.338712:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1783950878.338719:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783950878.338735:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1783950878.338741:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:3.0:1783950878.338756:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1783950878.338764:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783950878.338778:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1783950878.338797:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1783950878.338821:0:6519:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783950878.338823:0:6519:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783950878.338827:0:6519:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783950878.338865:0:6519:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783950878.338867:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783950878.340136:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783950878.340831:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783950878.340862:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783950878.340877:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783950878.340889:0:6519:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783950878.340891:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783950878.341638:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1783950878.341671:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1783950878.341691:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1783950878.341878:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1783950878.341918:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1783950878.341934:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1783950878.341944:0:6519:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783950878.341947:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783950878.342495:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1783950878.342518:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1783950878.342548:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783950878.342798:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1783950878.342823:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1783950878.342840:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1783950878.342851:0:6519:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783950878.342853:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783950878.343369:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1783950878.343399:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1783950878.343417:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1783950878.343656:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1783950878.343679:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1783950878.343696:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1783950878.343714:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783950878.343733:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343753:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343773:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343780:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343786:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343792:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343800:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343838:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.343853:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 18 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.343867:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796032:0@lo:104: 00000100:00100000:2.0:1783950878.343930:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950878.344031:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.344039:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 18 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.344048:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796160:0@lo:104: 00000100:00100000:2.0:1783950878.344076:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950878.344180:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.344188:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 18 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.344195:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796288:0@lo:104: 00000100:00100000:2.0:1783950878.344216:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950878.344457:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796032 00000100:00100000:0.0:1783950878.344465:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796032 00000100:00100000:0.0:1783950878.344590:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796160 00000100:00100000:0.0:1783950878.344594:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796160 00000100:00100000:0.0:1783950878.344610:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783950878.344619:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6519:x1870607944796032:12345-0@lo:104: 00010000:00010000:0.0:1783950878.344632:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344685:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783950878.344691:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6519:x1870607944796032:12345-0@lo:104: Request processed in 73us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.344699:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783950878.344715:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783950878.344721:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6519:x1870607944796160:12345-0@lo:104: 00010000:00010000:0.0:1783950878.344728:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344762:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783950878.344767:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6519:x1870607944796160:12345-0@lo:104: Request processed in 47us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.344786:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1783950878.344808:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783950878.344813:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344821:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950878.344825:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344834:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950878.344841:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950878.344846:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783950878.344877:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344884:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783950878.344903:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344909:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344923:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783950878.344926:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344942:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950878.344946:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344952:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950878.344958:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950878.344963:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783950878.344977:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344983:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783950878.344988:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.344994:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.345004:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950878.345005:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950878.345007:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950878.345014:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950878.345034:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944796416:0@lo:103: 00000100:00100000:0.0:1783950878.345078:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950878.345112:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950878.345118:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944796544:0@lo:103: 00000100:00100000:0.0:1783950878.345167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950878.345202:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796416 00000100:00100000:0.0:1783950878.345207:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796416 00010000:00010000:0.0:1783950878.345226:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 19 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950878.345248:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796544 00000100:00100000:0.0:1783950878.345251:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796544 00010000:00010000:0.0:1783950878.345262:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.345402:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.345411:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 20 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.345420:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796672:0@lo:104: 00000100:00100000:2.0:1783950878.345441:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950878.345463:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.345471:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.345569:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796800:0@lo:104: 00000100:00100000:2.0:1783950878.345604:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.345616:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.345636:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796032:0@lo:104: 00000100:00100000:2.0:1783950878.345645:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796160:0@lo:104: 00000100:00100000:1.0:1783950878.345717:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796288 00000100:00100000:1.0:1783950878.345721:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796288 00000100:00100000:1.0:1783950878.345745:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796672 00000100:00100000:1.0:1783950878.345747:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796672 00000100:00100000:1.0:1783950878.345755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796800 00000100:00100000:1.0:1783950878.345758:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796800 00000100:00100000:1.0:1783950878.345768:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783950878.345776:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:6519:x1870607944796288:12345-0@lo:104: 00010000:00010000:1.0:1783950878.345785:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.345837:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783950878.345842:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:6519:x1870607944796288:12345-0@lo:104: Request processed in 68us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.345847:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783950878.345860:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783950878.345867:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:6519:x1870607944796672:12345-0@lo:104: 00010000:00010000:1.0:1783950878.345874:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.345903:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783950878.345907:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:6519:x1870607944796672:12345-0@lo:104: Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.345912:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783950878.345932:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783950878.345938:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:6519:x1870607944796800:12345-0@lo:104: 00010000:00010000:1.0:1783950878.345945:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.345971:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783950878.345975:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:6519:x1870607944796800:12345-0@lo:104: Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.345981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783950878.346075:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950878.346087:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+20:3652:x1870607944796416:12345-0@lo:103: 00010000:00010000:3.0:1783950878.346098:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950878.346104:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346114:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145000/0x7645c8e1169f7d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7d1b expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346195:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950878.346231:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+19:3652:x1870607944796416:12345-0@lo:103: Request processed in 148us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.346237:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783950878.346381:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796288:0@lo:104: 00000100:00100000:2.0:1783950878.346398:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796672:0@lo:104: 00000100:00100000:2.0:1783950878.346404:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6519:1870607944796800:0@lo:104: 00010000:00010000:2.0:1783950878.346428:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346581:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783950878.346587:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346594:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950878.346598:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346606:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950878.346619:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950878.346624:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950878.346658:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346665:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950878.346683:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346691:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2e00/0x7645c8e1169f7cd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cdc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346702:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783950878.346705:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346710:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950878.346713:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346719:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950878.346725:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950878.346730:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950878.346749:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346755:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950878.346760:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346766:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ca4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346775:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783950878.346778:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346784:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950878.346786:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346792:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950878.346796:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950878.346800:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950878.346812:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346818:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950878.346829:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346845:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e9e00/0x7645c8e1169f7c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7c2d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.346860:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950878.346861:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950878.346863:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950878.346875:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944796928:0@lo:103: 00000100:00100000:3.0:1783950878.346907:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.346938:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950878.346943:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944797056:0@lo:103: 00000100:00100000:3.0:1783950878.346978:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.347008:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944796928 00000100:00100000:3.0:1783950878.347013:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944796928 00010000:00010000:3.0:1783950878.347031:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 19 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950878.347046:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797056 00000100:00100000:3.0:1783950878.347048:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797056 00010000:00010000:3.0:1783950878.347057:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 20 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950878.347067:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783950878.347072:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+20:3654:x1870607944796928:12345-0@lo:103: 00010000:00010000:3.0:1783950878.347081:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950878.347084:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 20 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.347093:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 20 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.347110:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7cdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7cd5 expref: 20 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.347120:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950878.347176:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+19:3654:x1870607944796928:12345-0@lo:103: Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.347182:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783950878.347197:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783950878.347203:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+18:3654:x1870607944797056:12345-0@lo:103: 00010000:00010000:3.0:1783950878.347211:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950878.347215:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 18 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.347223:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 18 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.347232:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3e00/0x7645c8e1169f7ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7c9d expref: 18 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.347240:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950878.347261:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+17:3654:x1870607944797056:12345-0@lo:103: Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.347267:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783950878.347549:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783950878.347558:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944797184:0@lo:103: 00000100:00100000:3.0:1783950878.347586:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.347624:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944797056:0@lo:103: 00000100:00100000:3.0:1783950878.347645:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944796928:0@lo:103: 00000100:00100000:3.0:1783950878.347664:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797184 00000100:00100000:3.0:1783950878.347667:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797184 00010000:00010000:3.0:1783950878.347680:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950878.347895:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783950878.347904:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+17:3652:x1870607944796544:12345-0@lo:103: 00010000:00010000:0.0:1783950878.347913:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783950878.347918:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.347929:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.347939:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7cf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7cf1 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.347948:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783950878.347977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+16:3652:x1870607944796544:12345-0@lo:103: Request processed in 75us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.347983:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783950878.348049:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944796544:0@lo:103: 00000100:00100000:1.0:1783950878.348059:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944796416:0@lo:103: 00000100:00100000:2.0:1783950878.348123:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783950878.348132:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+15:3653:x1870607944797184:12345-0@lo:103: 00010000:00010000:2.0:1783950878.348169:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950878.348175:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 15 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348184:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 15 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348194:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f7c2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7c26 expref: 15 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348205:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348214:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348229:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348235:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348242:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348255:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348262:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783950878.348266:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348284:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348299:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348307:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950878.348341:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+14:3653:x1870607944797184:12345-0@lo:103: Request processed in 210us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.348348:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1783950878.348390:0:6519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348398:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.348404:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783950878.348415:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783950878.348635:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944797184:0@lo:103: 00010000:00010000:1.0:1783950878.349303:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950878.351205:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+13:8432:x1870607944795904:12345-0@lo:253: Request processed in 14681us (14907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.351220:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783950878.351559:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944795904:0@lo:253: 10000000:01000000:2.0:1783950878.351578:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783950878.351593:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783950878.351594:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783950878.351596:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950878.351597:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783950878.351598:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950878.351600:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950878.351601:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783950878.351602:0:8432:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783950878.351604:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950878.351605:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783950878.351638:0:8432:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0377952800 from lustre-OST0000 10000000:01000000:2.0:1783950878.351669:0:8432:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783950878.351672:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783950878.351680:0:8432:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e036d35b380 local copy 10000000:01000000:2.0:1783950878.351684:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783950878.351722:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.351733:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.351743:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.351762:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797312:0@lo:101: 00000100:00100000:2.0:1783950878.351803:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.351924:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.352110:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797312 00000100:00100000:0.0:1783950878.352117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797312 00000100:00100000:0.0:1783950878.352196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783950878.352212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+13:8432:x1870607944797312:12345-0@lo:101: 00010000:00010000:0.0:1783950878.352225:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950878.352237:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7d68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.352260:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7d68 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.352284:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d68 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.352293:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031c00, rc 0) 00000100:00100000:0.0:1783950878.352333:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944797312:12345-0@lo:101: Request processed in 122us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.352339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783950878.352700:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797312:0@lo:101: 00010000:00010000:3.0:1783950878.352714:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.352722:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950878.352831:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797440:0@lo:501: 00000100:00100000:3.0:1783950878.352862:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.352893:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985300 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.352948:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797440 00000100:00100000:2.0:1783950878.352953:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797440 00000100:00100000:2.0:1783950878.352977:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783950878.352983:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944797440:12345-0@lo:501: 00000100:00100000:2.0:1783950878.353054:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944797440:12345-0@lo:501: Request processed in 70us (190us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783950878.353071:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783950878.353220:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797440:0@lo:501: 10000000:01000000:3.0:1783950878.353233:0:8432:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783950878.353251:0:8432:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783950878.353256:0:8432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.353264:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.353391:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.353413:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783950878.353437:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0377952800 10000000:01000000:3.0:1783950878.353442:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783950878.353447:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783950878.353450:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783950878.353454:0:8432:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783950878.353456:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783950878.353633:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783950878.353640:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.353662:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.353670:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.353678:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950878.353692:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797568:0@lo:101: 00000100:00100000:3.0:1783950878.353723:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.353748:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.353802:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797568 00000100:00100000:2.0:1783950878.353807:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797568 00000100:00100000:2.0:1783950878.353839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783950878.353847:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944797568:12345-0@lo:101: 00010000:00010000:2.0:1783950878.353855:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950878.353867:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7d76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.353885:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.353895:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.353903:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c3800, rc 0) 00000100:00100000:2.0:1783950878.353934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944797568:12345-0@lo:101: Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.353940:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783950878.354012:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797568:0@lo:101: 00010000:00010000:0.0:1783950878.354126:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950878.354131:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.354202:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950878.354211:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950878.354216:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783950878.354244:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.354250:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783950878.354374:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944797696:0@lo:103: 00000100:00100000:1.0:1783950878.354406:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783950878.354456:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.354464:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7d6f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.354636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797696 00000100:00100000:2.0:1783950878.354641:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797696 00000100:00100000:2.0:1783950878.354675:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950878.354682:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+15:3653:x1870607944797696:12345-0@lo:103: 00010000:00010000:2.0:1783950878.354692:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950878.354703:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7d68 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.354713:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783950878.354782:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.354790:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950878.354880:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797824:0@lo:501: 00000100:00100000:3.0:1783950878.354908:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.354933:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 11 seconds 00010000:00010000:0.0:1783950878.355211:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950878.355213:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950878.355216:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950878.355232:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797824 00000100:00100000:0.0:1783950878.355236:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797824 00000100:00100000:0.0:1783950878.355277:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783950878.355284:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944797824:12345-0@lo:501: 00000100:00100000:0.0:1783950878.355403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944797824:12345-0@lo:501: Request processed in 119us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.355410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783950878.355733:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797824:0@lo:501: 00000100:00100000:3.0:1783950878.355764:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797952:0@lo:503: 00000100:00100000:3.0:1783950878.355809:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.355835:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944797952 00000100:00100000:3.0:1783950878.355839:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944797952 00000100:00100000:3.0:1783950878.355863:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783950878.355869:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944797952:12345-0@lo:503: 00000100:00100000:3.0:1783950878.355941:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944797952:12345-0@lo:503: Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.355947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783950878.355988:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 11 seconds 00000100:00100000:3.0:1783950878.356002:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944797952:0@lo:503: 00000040:00080000:3.0:1783950878.356346:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783950878.356655:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798080:0@lo:502: 00000100:00100000:3.0:1783950878.356698:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.356766:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.356917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+14:3653:x1870607944797696:12345-0@lo:103: Request processed in 2233us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.356926:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783950878.357027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798080 00000100:00100000:0.0:1783950878.357034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798080 00000100:00100000:0.0:1783950878.357102:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783950878.357110:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944798080:12345-0@lo:502: 00000100:00100000:0.0:1783950878.357247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944798080:12345-0@lo:502: Request processed in 137us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.357253:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783950878.357391:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798080:0@lo:502: 00000100:00100000:1.0:1783950878.357705:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944797696:0@lo:103: 00000040:00080000:2.0:1783950878.358040:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783950878.358075:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783950878.358095:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783950878.358111:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783950878.358129:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783950878.358170:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783950878.358205:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798208:0@lo:502: 00000100:00100000:2.0:1783950878.358251:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.358410:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.358603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798208 00000100:00100000:0.0:1783950878.358609:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798208 00000100:00100000:0.0:1783950878.358656:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783950878.358664:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944798208:12345-0@lo:502: 00000100:00100000:0.0:1783950878.358767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944798208:12345-0@lo:502: Request processed in 104us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.358775:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783950878.358904:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798208:0@lo:502: 00000040:00080000:2.0:1783950878.358965:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783950878.358974:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1783950878.359960:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783950878.359968:0:8456:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783950878.359974:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950878.359977:0:8456:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783950878.359983:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783950878.359998:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e03779599c0) 00000020:00000080:3.0:1783950878.360027:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783950878.360033:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783950878.360113:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0377952800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783950878.360120:0:8456:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783950878.360128:0:8456:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7645c8e1169f7d8b 00010000:00010000:2.0:1783950878.366853:0:8456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1783950878.367644:0:8456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783950878.371617:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783950878.371973:0:8456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783950878.378763:0:8456:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783950878.378964:0:8456:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783950878.385917:0:8456:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1783950878.387451:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783950878.387464:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950878.387471:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950878.387472:0:8456:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783950878.387642:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950878.387649:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950878.387651:0:8456:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783950878.387654:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783950878.387656:0:8456:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783950878.387691:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950878.387694:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950878.387695:0:8456:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783950878.387698:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783950878.387952:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1783950878.387981:0:8432:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783950878.388005:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.388016:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950878.388037:0:8432:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377952800 from 1 10000000:01000000:2.0:1783950878.388039:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783950878.388075:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.388083:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.388093:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.388115:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798336:0@lo:101: 00000100:00100000:2.0:1783950878.388210:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.388248:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647240 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.388402:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798336 00000100:00100000:0.0:1783950878.388410:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798336 00000100:00100000:0.0:1783950878.388461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783950878.388470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:8432:x1870607944798336:12345-0@lo:101: 00010000:00010000:0.0:1783950878.388655:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950878.388668:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7d92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.388692:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.388702:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.388722:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030a00, rc 0) 00000100:00100000:0.0:1783950878.388773:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798336:12345-0@lo:101: Request processed in 304us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.388780:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783950878.388859:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798336:0@lo:101: 00010000:00010000:2.0:1783950878.388875:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.388884:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.388988:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798464:0@lo:501: 00000100:00100000:2.0:1783950878.389017:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.389040:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647240 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.389085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798464 00000100:00100000:0.0:1783950878.389090:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798464 00000100:00100000:0.0:1783950878.389709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783950878.389719:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798464:12345-0@lo:501: 00000100:00100000:0.0:1783950878.389824:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798464:12345-0@lo:501: Request processed in 107us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.389831:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783950878.395335:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798464:0@lo:501: 00000100:00100000:3.0:1783950878.395570:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798592:0@lo:503: 00000100:00100000:3.0:1783950878.395649:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.397749:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.397836:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798592 00000100:00100000:2.0:1783950878.397865:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798592 00000100:00100000:2.0:1783950878.397923:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783950878.397933:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798592:12345-0@lo:503: 00000100:00100000:2.0:1783950878.398107:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798592:12345-0@lo:503: Request processed in 175us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.398116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783950878.398191:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798592:0@lo:503: 00000040:00080000:2.0:1783950878.398740:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783950878.398820:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798720:0@lo:502: 00000100:00100000:2.0:1783950878.398871:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.398907:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.398930:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798720 00000100:00100000:2.0:1783950878.398935:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798720 00000100:00100000:2.0:1783950878.398954:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783950878.398961:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798720:12345-0@lo:502: 00000100:00100000:2.0:1783950878.399049:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798720:12345-0@lo:502: Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.399056:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783950878.399094:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798720:0@lo:502: 00000040:00080000:2.0:1783950878.399613:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783950878.399648:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783950878.399672:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798848:0@lo:502: 00000100:00100000:2.0:1783950878.399709:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.399742:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:2.0:1783950878.399763:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798848 00000100:00100000:2.0:1783950878.399767:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798848 00000100:00100000:2.0:1783950878.399789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783950878.399796:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798848:12345-0@lo:502: 00000100:00100000:2.0:1783950878.399871:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798848:12345-0@lo:502: Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.399883:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783950878.399919:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798848:0@lo:502: 00000040:00080000:2.0:1783950878.399957:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783950878.399965:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783950878.400806:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950878.400817:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950878.400819:0:8460:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783950878.400826:0:8460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0377952800 00000020:00000080:0.0:1783950878.400829:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783950878.400841:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950878.400844:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950878.400845:0:8460:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783950878.400848:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783950878.400980:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783950878.401005:0:8432:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783950878.401027:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.401038:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950878.401080:0:8432:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783950878.401084:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0377952800 10000000:01000000:2.0:1783950878.401087:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0377952800 10000000:01000000:2.0:1783950878.401091:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783950878.401097:0:8432:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377952800 from 1 10000000:01000000:2.0:1783950878.401100:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783950878.401129:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.401164:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.401175:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.401194:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798976:0@lo:101: 00000100:00100000:2.0:1783950878.401241:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.401557:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950878.401640:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944798976 00000100:00100000:3.0:1783950878.401647:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944798976 00000100:00100000:3.0:1783950878.401688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783950878.401697:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8432:x1870607944798976:12345-0@lo:101: 00010000:00010000:3.0:1783950878.401709:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950878.401721:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7da0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.401743:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.401752:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.401761:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2e00, rc 0) 00000100:00100000:3.0:1783950878.401798:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944798976:12345-0@lo:101: Request processed in 102us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.401805:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783950878.401888:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944798976:0@lo:101: 00010000:00010000:2.0:1783950878.401902:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.401912:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.401988:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799104:0@lo:501: 00000100:00100000:2.0:1783950878.402015:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.402037:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.402087:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799104 00000100:00100000:0.0:1783950878.402091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799104 00000100:00100000:0.0:1783950878.402113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783950878.402120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799104:12345-0@lo:501: 00000100:00100000:0.0:1783950878.402250:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799104:12345-0@lo:501: Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.402256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783950878.402774:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799104:0@lo:501: 00000100:00100000:2.0:1783950878.402806:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799232:0@lo:503: 00000100:00100000:2.0:1783950878.402848:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.402878:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.402944:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799232 00000100:00100000:0.0:1783950878.402949:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799232 00000100:00100000:0.0:1783950878.402982:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783950878.402988:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799232:12345-0@lo:503: 00000100:00100000:0.0:1783950878.403077:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799232:12345-0@lo:503: Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.403084:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783950878.403228:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799232:0@lo:503: 00000040:00080000:2.0:1783950878.403759:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783950878.403834:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799360:0@lo:502: 00000100:00100000:2.0:1783950878.403876:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.403911:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:1.0:1783950878.404029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799360 00000100:00100000:1.0:1783950878.404035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799360 00000100:00100000:1.0:1783950878.404072:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783950878.404080:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799360:12345-0@lo:502: 00000100:00100000:1.0:1783950878.404241:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799360:12345-0@lo:502: Request processed in 161us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.404247:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783950878.404697:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799360:0@lo:502: 00000040:00080000:2.0:1783950878.404903:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783950878.404934:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783950878.404951:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783950878.404965:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783950878.404981:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783950878.404995:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783950878.405022:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783950878.405038:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783950878.405054:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783950878.405068:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783950878.405083:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783950878.405099:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783950878.405114:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783950878.405129:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783950878.405738:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783950878.405797:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783950878.405814:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783950878.405827:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783950878.405842:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783950878.405858:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783950878.405871:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783950878.405886:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783950878.405901:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783950878.405917:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783950878.405933:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783950878.405950:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783950878.405968:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783950878.405985:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1783950878.406002:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783950878.406016:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1783950878.406032:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1783950878.406062:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1783950878.406080:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1783950878.406094:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1783950878.406107:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1783950878.406123:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1783950878.406137:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1783950878.406463:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799488:0@lo:502: 00000100:00100000:2.0:1783950878.406623:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950878.406711:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950878.411214:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799488 00000100:00100000:3.0:1783950878.411242:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799488 00000100:00100000:3.0:1783950878.411597:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783950878.411610:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799488:12345-0@lo:502: 00000100:00100000:3.0:1783950878.411791:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944799488:12345-0@lo:502: Request processed in 184us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.411799:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783950878.411975:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944799488:0@lo:502: 00000040:00080000:2.0:1783950878.412062:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1783950878.412076:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783950878.413074:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783950878.413090:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e037d0a8000) 00000020:00000080:2.0:1783950878.413114:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783950878.413796:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0377952800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783950878.413803:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0377952800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783950878.413805:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377952800 3 00010000:00080000:2.0:1783950878.413835:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e02466dd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783950878.418019:0:8461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1783950878.418698:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783950878.418754:0:8461:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783950878.418769:0:8461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7645c8e1169f7db5 00000100:00080000:2.0:1783950878.418779:0:8461:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783950878.418785:0:8461:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e02466dd800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783950878.418820:0:8461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abd500 x1870607944799616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783950878.418907:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944799616:0@lo:38: 00000100:00100000:3.0:1783950878.418976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783950878.419035:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783950878.427798:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944799744:0@lo:400: 00000100:00100000:3.0:1783950878.427877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950878.428682:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944800000:0@lo:400: 00000100:00100000:1.0:1783950878.428732:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944800128:0@lo:400: 00000100:00100000:1.0:1783950878.428773:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950878.428829:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800128 00000100:00100000:1.0:1783950878.428836:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800128 00000100:00100000:1.0:1783950878.428891:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783950878.428901:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944800128:12345-0@lo:400: 00000100:00100000:1.0:1783950878.428958:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944800128:12345-0@lo:400: Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.428966:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783950878.429007:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944800128:0@lo:400: 00000020:01000004:2.0:1783950878.431875:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783950878.431894:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e037d0a99c0) 00000020:00000080:2.0:1783950878.431916:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1783950878.432075:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0377952800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783950878.432079:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0377952800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783950878.432082:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377952800 3 00010000:00080000:2.0:1783950878.432108:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e02466da000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.133@tcp at head 00000100:00100000:3.0:1783950878.433329:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950878.433344:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944799872:0@lo:400: 00000100:00100000:3.0:1783950878.433412:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.433468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950878.436839:0:8461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1783950878.436953:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783950878.436996:0:8461:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783950878.437009:0:8461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7645c8e1169f7dc3 00000100:00080000:2.0:1783950878.437020:0:8461:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783950878.437026:0:8461:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e02466da000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783950878.437064:0:8461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abdf80 x1870607944800256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783950878.437085:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783950878.437744:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799616 00000100:00100000:0.0:1783950878.437754:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799616 00000100:00100000:0.0:1783950878.437818:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799744 00000100:00100000:0.0:1783950878.437822:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799744 00000100:00100000:0.0:1783950878.437850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783950878.437860:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944799744:12345-0@lo:400: 00000100:00100000:0.0:1783950878.437952:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944799744:12345-0@lo:400: Request processed in 93us (10074us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.437959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783950878.437975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783950878.437980:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944799616:12345-0@lo:38: 00010000:00080000:0.0:1783950878.438000:0:6526:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:0.0:1783950878.438029:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7645c8e1169f7dca 00000004:00100000:0.0:1783950878.438046:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783950878.438077:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9e024667a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783950878.438113:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1870607944799616:12345-0@lo:38: Request processed in 131us (19136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.438119:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783950878.438178:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037d246d80 x1870607944799744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950878.438207:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944799744:0@lo:400: 00000100:00100000:0.0:1783950878.440750:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607944800256:0@lo:38: 00000040:00080000:2.0:1783950878.441987:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1783950878.442329:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783950878.442359:0:8432:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783950878.442579:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950878.442591:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783950878.442644:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783950878.442646:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783950878.442648:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783950878.442649:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783950878.442650:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783950878.442652:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783950878.442654:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783950878.442655:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783950878.442661:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783950878.442663:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783950878.442664:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783950878.442667:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1783950878.442670:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783950878.442671:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783950878.442672:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783950878.442673:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783950878.442674:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783950878.442675:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783950878.442676:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783950878.442677:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783950878.442678:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783950878.442679:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783950878.442680:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783950878.442706:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783950878.442723:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944800384:0@lo:253: 00000100:00100000:3.0:1783950878.442781:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.442812:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950878.442836:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944799872 00000100:00100000:3.0:1783950878.442844:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944799872 00000100:00100000:3.0:1783950878.442887:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783950878.442896:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944799872:12345-0@lo:400: 00000100:00100000:3.0:1783950878.442953:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944799872:12345-0@lo:400: Request processed in 56us (9540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950878.442959:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783950878.443074:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800000 00000100:00100000:1.0:1783950878.443079:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800000 00000100:00100000:1.0:1783950878.443106:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800384 00000100:00100000:1.0:1783950878.443109:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800384 00000100:00100000:1.0:1783950878.443134:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783950878.443156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944800384:12345-0@lo:253: 20000000:01000000:1.0:1783950878.443188:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783950878.443205:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783950878.443785:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783950878.443844:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0377abd500 x1870607944799616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783950888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950878.443854:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783950878.443865:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783950878.443873:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783950878.443878:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783950878.443882:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783950878.443890:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944799616:0@lo:38: 00000100:00100000:0.0:1783950878.443928:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944799872:0@lo:400: 00000100:00100000:0.0:1783950878.443969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800256 00000100:00100000:0.0:1783950878.443974:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800256 00000100:00100000:0.0:1783950878.443989:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783950878.443996:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944800000:12345-0@lo:400: 00000100:00100000:0.0:1783950878.444046:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944800000:12345-0@lo:400: Request processed in 51us (10577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.444053:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783950878.444066:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783950878.444070:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944800256:12345-0@lo:38: 00010000:00080000:0.0:1783950878.444110:0:6526:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:0.0:1783950878.444178:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7645c8e1169f7dd1 00000004:00100000:0.0:1783950878.444195:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783950878.444239:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9e024667e000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1783950878.451800:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037d245c00 x1870607944800000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950878.451821:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944800000:0@lo:400: 00000100:00100000:0.0:1783950878.458742:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1870607944800256:12345-0@lo:38: Request processed in 14660us (14948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.458758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:3.0:1783950878.459507:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783950878.459531:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783950878.459864:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783950878.459869:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783950878.459894:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.459913:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.459920:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.459927:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.459969:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.459983:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950878.459996:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944800512:0@lo:104: 00000100:00100000:0.0:1783950878.460062:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783950878.460111:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.460119:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 16 pid: 6519 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950878.460195:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944800640:0@lo:104: 00000100:00100000:0.0:1783950878.460219:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1300 going to sleep for 11 seconds 00000100:00100000:0.0:1783950878.460647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:8432:x1870607944800384:12345-0@lo:253: Request processed in 17504us (17864us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.460656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783950878.460807:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783950878.460826:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950878.460842:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800512 00000100:00100000:1.0:1783950878.460849:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800512 00000100:00100000:1.0:1783950878.460885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800640 00000100:00100000:1.0:1783950878.460889:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800640 00000100:00100000:1.0:1783950878.460903:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783950878.460910:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038086e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944800512:12345-0@lo:104: 00010000:00010000:1.0:1783950878.460922:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.460966:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783950878.460979:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038086e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944800512:12345-0@lo:104: Request processed in 70us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.460986:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783950878.461015:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783950878.461022:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944800640:12345-0@lo:104: 00010000:00010000:1.0:1783950878.461029:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461062:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783950878.461067:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944800640:12345-0@lo:104: Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950878.461071:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1783950878.461089:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783950878.461095:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461101:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950878.461105:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461113:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950878.461121:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950878.461127:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950878.461181:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461198:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950878.461217:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461224:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145a00/0x7645c8e1169f7ce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461236:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950878.461238:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461243:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950878.461245:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.461251:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950878.461256:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950878.461260:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1783950878.461401:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944800512:0@lo:104: 00000100:00100000:0.0:1783950878.461412:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944800640:0@lo:104: 00010000:00010000:0.0:1783950878.461434:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.461451:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950878.461466:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944800768:0@lo:103: 00000100:00100000:0.0:1783950878.461506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950878.461565:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800768 00000100:00100000:0.0:1783950878.461569:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800768 00010000:00010000:0.0:1783950878.461589:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950878.461620:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783950878.461627:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+16:3654:x1870607944800768:12345-0@lo:103: 00010000:00010000:0.0:1783950878.461638:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783950878.461644:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.461653:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.461680:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f7cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7ce3 expref: 16 pid: 6520 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950878.461692:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783950878.461723:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+15:3654:x1870607944800768:12345-0@lo:103: Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.461729:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783950878.461755:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944800768:0@lo:103: 00010000:00010000:1.0:1783950878.462179:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.462186:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950878.462199:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.462205:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c2c00/0x7645c8e1169f7cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7cce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950878.462226:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950878.462228:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950878.462230:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950878.462242:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944800896:0@lo:103: 00000100:00100000:1.0:1783950878.462284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950878.462416:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:8432:1870607944800384:0@lo:253: 10000000:01000000:3.0:1783950878.462436:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783950878.462439:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783950878.462440:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783950878.462442:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783950878.462443:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783950878.462444:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783950878.462445:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783950878.462446:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783950878.462448:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783950878.462449:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783950878.462450:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783950878.462452:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783950878.462463:0:8432:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00080000:2.0:1783950878.465472:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0377abdf80 x1870607944800256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783950888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950878.465570:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783950878.465583:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783950878.465594:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783950878.465601:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783950878.465605:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02466da000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783950878.465613:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607944800256:0@lo:38: 00000100:00100000:2.0:1783950878.465654:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944800896 00000100:00100000:2.0:1783950878.465661:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944800896 00010000:00010000:2.0:1783950878.465690:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 15 pid: 6519 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950878.465817:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783950878.465827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+15:3655:x1870607944800896:12345-0@lo:103: 00010000:00010000:2.0:1783950878.465843:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950878.465850:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 15 pid: 6519 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465871:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 15 pid: 6519 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465890:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7cce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7cc7 expref: 15 pid: 6519 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465906:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465915:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783950878.465932:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006063757s 00010000:00010000:2.0:1783950878.465937:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465945:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465952:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465959:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465966:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783950878.465971:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.465980:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1783950878.465999:0:8432:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:2.0:1783950878.466005:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.466020:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950878.466093:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+14:3655:x1870607944800896:12345-0@lo:103: Request processed in 267us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950878.466102:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1783950878.466185:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.466195:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950878.466202:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7dd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1783950878.466228:0:8432:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:2.0:1783950878.466239:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944800896:0@lo:103: 00080000:10000000:3.0:1783950878.466428:0:8432:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783950878.466605:0:8432:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783950878.466815:0:8432:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783950878.467039:0:8432:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1783950878.468477:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783950878.480087:0:8432:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783950878.480097:0:8432:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783950878.480133:0:8432:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783950878.480558:0:8432:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783950878.480586:0:8432:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783950878.480605:0:8432:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783950878.483731:0:8432:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783950878.483932:0:8432:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1783950878.816663:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944801024:0@lo:41: 00000100:00100000:0.0:1783950878.816731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950878.816802:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801024 00000100:00100000:0.0:1783950878.816809:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801024 00000100:00100000:0.0:1783950878.816852:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783950878.816861:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944801024:12345-0@lo:41: 00000004:00000024:0.0:1783950878.816895:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783950878.816944:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944801024:12345-0@lo:41: Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950878.816951:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783950878.816996:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944801024:0@lo:41: 00010000:00010000:2.0:1783950878.822010:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783950879.449869:0:8517:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950879.450626:0:8517:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783950879.841749:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950880.865376:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950881.888654:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950881.888694:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944801152:0@lo:41: 00000100:00100000:1.0:1783950881.888801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950881.888996:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801152 00000100:00100000:2.0:1783950881.889006:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801152 00000100:00100000:2.0:1783950881.889061:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783950881.889071:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944801152:12345-0@lo:41: 00000004:00000024:2.0:1783950881.889130:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1783950881.890017:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944801152:12345-0@lo:41: Request processed in 940us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950881.890029:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783950881.890532:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944801152:0@lo:41: 00010000:00010000:1.0:1783950881.890824:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950882.912312:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950883.936333:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783950883.936357:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944801280:0@lo:41: 00000100:00100000:0.0:1783950883.936423:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950883.936525:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801280 00000100:00100000:0.0:1783950883.936544:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801280 00000100:00100000:0.0:1783950883.936611:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783950883.936620:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944801280:12345-0@lo:41: 00000004:00000024:0.0:1783950883.936656:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783950883.936703:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944801280:12345-0@lo:41: Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950883.936709:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783950883.936757:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944801280:0@lo:41: 00000100:00100000:0.0:1783950883.938360:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944801536:0@lo:400: 00000100:00100000:0.0:1783950883.938417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950883.938447:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944802048:0@lo:400: 00000100:00100000:0.0:1783950883.938495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950883.938530:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950883.938536:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944801664:0@lo:400: 00000100:00100000:0.0:1783950883.938564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950883.938648:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944801792:0@lo:400: 00000100:00100000:3.0:1783950883.938678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950883.938759:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944801408:0@lo:400: 00000100:00100000:2.0:1783950883.938792:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950883.938918:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950883.947918:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801536 00000100:00100000:0.0:1783950883.947932:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801536 00000100:00100000:0.0:1783950883.947980:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802048 00000100:00100000:0.0:1783950883.947984:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802048 00000100:00100000:0.0:1783950883.948024:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801792 00000100:00100000:0.0:1783950883.948027:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801792 00000100:00100000:0.0:1783950883.948046:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783950883.948055:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944801536:12345-0@lo:400: 00000100:00100000:0.0:1783950883.948163:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944801536:12345-0@lo:400: Request processed in 87us (9723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950883.948171:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783950883.948188:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783950883.948194:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944802048:12345-0@lo:400: 00000100:00100000:0.0:1783950883.948244:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944802048:12345-0@lo:400: Request processed in 50us (9749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950883.948250:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783950883.948262:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783950883.948268:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944801792:12345-0@lo:400: 00000100:00100000:0.0:1783950883.948299:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944801792:12345-0@lo:400: Request processed in 31us (9620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950883.948305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783950883.948337:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801664 00000100:00100000:0.0:1783950883.948341:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801664 00000100:00100000:0.0:1783950883.948364:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950883.948371:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944801664:12345-0@lo:400: 00000100:00100000:0.0:1783950883.948405:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944801664:12345-0@lo:400: Request processed in 34us (9839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950883.948411:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950883.948449:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944801664:0@lo:400: 00010000:00080000:0.0:1783950883.948466:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b97800 x1870607944801536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950883.948485:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944801536:0@lo:400: 00010000:00080000:0.0:1783950883.948498:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b94e00 x1870607944802048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950883.948506:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944802048:0@lo:400: 00000100:00080000:3.0:1783950883.948745:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783950883.948767:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b96a00 x1870607944801792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950883.948778:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944801792:0@lo:400: 00000100:00100000:2.0:1783950883.948952:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944801920:0@lo:400: 00000100:00100000:2.0:1783950883.948992:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950883.949060:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801920 00000100:00100000:3.0:1783950883.949064:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801920 00000100:00100000:3.0:1783950883.949104:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783950883.949110:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944801920:12345-0@lo:400: 00000100:00100000:3.0:1783950883.949168:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944801920:12345-0@lo:400: Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950883.949175:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1783950883.949231:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783950883.949252:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b96d80 x1870607944801920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950883.949261:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944801920:0@lo:400: 00000100:00100000:0.0:1783950883.949323:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944801408 00000100:00100000:0.0:1783950883.949328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944801408 00000100:00100000:0.0:1783950883.949363:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783950883.949376:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:3655:x1870607944801408:12345-0@lo:400: 00000100:00100000:0.0:1783950883.949419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:3655:x1870607944801408:12345-0@lo:400: Request processed in 43us (10625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950883.949425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783950883.949506:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944801408:0@lo:400: 10000000:01000000:2.0:1783950884.448759:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783950884.448767:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377b14000 from 30 10000000:01000000:2.0:1783950884.448772:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783950884.448819:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.448831:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.448842:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950884.448865:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802176:0@lo:101: 00000100:00100000:2.0:1783950884.448944:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.449010:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783950884.449072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802176 00000100:00100000:0.0:1783950884.449079:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802176 00000100:00100000:0.0:1783950884.449134:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783950884.449164:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:6522:x1870607944802176:12345-0@lo:101: 00010000:00010000:0.0:1783950884.449179:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950884.449193:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7ddf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.449217:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.449228:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.449237:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031800, rc 0) 00000100:00100000:0.0:1783950884.449281:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944802176:12345-0@lo:101: Request processed in 118us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.449288:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783950884.449501:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802176:0@lo:101: 00010000:00010000:3.0:1783950884.449517:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.449527:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950884.449592:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802304:0@lo:501: 00000100:00100000:3.0:1783950884.449618:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.449741:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.451035:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802304 00000100:00100000:2.0:1783950884.451046:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802304 00000100:00100000:2.0:1783950884.451103:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783950884.451112:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944802304:12345-0@lo:501: 00000100:00100000:2.0:1783950884.452763:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944802304:12345-0@lo:501: Request processed in 1644us (3135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.452777:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783950884.455219:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802304:0@lo:501: 00000100:00100000:1.0:1783950884.455481:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802432:0@lo:503: 00000100:00100000:1.0:1783950884.455562:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.455607:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783950884.455717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802432 00000100:00100000:0.0:1783950884.455725:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802432 00000100:00100000:0.0:1783950884.455770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783950884.455780:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944802432:12345-0@lo:503: 00000100:00100000:0.0:1783950884.455901:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944802432:12345-0@lo:503: Request processed in 121us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.455917:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783950884.455991:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802432:0@lo:503: 00000100:00100000:2.0:1783950884.460940:0:8749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8749:1870607944802560:0@lo:502: 00000100:00100000:2.0:1783950884.461028:0:8749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.461070:0:8749:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416180 going to sleep for 11 seconds 00000100:00100000:0.0:1783950884.461220:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802560 00000100:00100000:0.0:1783950884.461228:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802560 00000100:00100000:0.0:1783950884.461276:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783950884.461286:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8749:x1870607944802560:12345-0@lo:502: 00000100:00100000:0.0:1783950884.462132:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:8749:x1870607944802560:12345-0@lo:502: Request processed in 843us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.462160:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783950884.473885:0:8749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8749:1870607944802560:0@lo:502: 00000100:00100000:0.0:1783950884.474131:0:8749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8749:1870607944802688:0@lo:502: 00000100:00100000:0.0:1783950884.474240:0:8749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.474281:0:8749:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.474358:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802688 00000100:00100000:3.0:1783950884.474365:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802688 00000100:00100000:3.0:1783950884.474420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783950884.474430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:8749:x1870607944802688:12345-0@lo:502: 00000100:00100000:3.0:1783950884.474575:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:8749:x1870607944802688:12345-0@lo:502: Request processed in 146us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.474584:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783950884.474778:0:8749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8749:1870607944802688:0@lo:502: 00000040:00080000:2.0:1783950884.474800:0:8749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783950884.474961:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783950884.474983:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783950884.474993:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.475005:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950884.475013:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783950884.475016:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 5 10000000:01000000:0.0:1783950884.475019:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783950884.475046:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.475053:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.475075:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950884.475089:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802816:0@lo:101: 00000100:00100000:0.0:1783950884.475119:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.475168:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.475217:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802816 00000100:00100000:2.0:1783950884.475222:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802816 00000100:00100000:2.0:1783950884.475250:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783950884.475256:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944802816:12345-0@lo:101: 00010000:00010000:2.0:1783950884.475265:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950884.475277:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7ded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.475298:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.475318:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.475334:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2400, rc 0) 00000100:00100000:2.0:1783950884.475373:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944802816:12345-0@lo:101: Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.475379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783950884.475493:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802816:0@lo:101: 00010000:00010000:0.0:1783950884.475506:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.475515:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950884.475556:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802944:0@lo:256: 00000100:00100000:0.0:1783950884.475602:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.475624:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.475677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944802944 00000100:00100000:3.0:1783950884.475682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944802944 00000100:00100000:3.0:1783950884.475711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783950884.475717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944802944:12345-0@lo:256: 20000000:01000000:3.0:1783950884.475730:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783950884.475752:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783950884.475756:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783950884.475835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944802944:12345-0@lo:256: Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.475843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783950884.475906:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944802944:0@lo:256: 10000000:01000000:0.0:1783950884.475946:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783950884.475952:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.475959:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950884.475967:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783950884.475969:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1783950884.475976:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783950884.475991:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.475999:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.476006:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950884.476017:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803072:0@lo:101: 00000100:00100000:0.0:1783950884.476040:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.476062:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.476102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803072 00000100:00100000:3.0:1783950884.476107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803072 00000100:00100000:3.0:1783950884.476155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783950884.476162:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944803072:12345-0@lo:101: 00010000:00010000:3.0:1783950884.476170:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950884.476179:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7dfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.476192:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.476200:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.476206:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3400, rc 0) 00000100:00100000:3.0:1783950884.476232:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944803072:12345-0@lo:101: Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.476237:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783950884.476384:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803072:0@lo:101: 00010000:00010000:0.0:1783950884.476395:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950884.476402:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950884.476447:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803200:0@lo:501: 00000100:00100000:0.0:1783950884.476483:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.476502:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.476595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803200 00000100:00100000:3.0:1783950884.476599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803200 00000100:00100000:3.0:1783950884.476628:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783950884.476635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944803200:12345-0@lo:501: 00000100:00100000:3.0:1783950884.476747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944803200:12345-0@lo:501: Request processed in 113us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.476763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783950884.476833:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803200:0@lo:501: 00000100:00100000:0.0:1783950884.476859:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803328:0@lo:503: 00000100:00100000:0.0:1783950884.476898:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.476918:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.476980:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803328 00000100:00100000:2.0:1783950884.476985:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803328 00000100:00100000:2.0:1783950884.477015:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783950884.477021:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944803328:12345-0@lo:503: 00000100:00100000:2.0:1783950884.477097:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944803328:12345-0@lo:503: Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.477103:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783950884.477192:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803328:0@lo:503: 00000100:00100000:3.0:1783950884.477633:0:8752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8752:1870607944803456:0@lo:502: 00000100:00100000:3.0:1783950884.477671:0:8752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.477693:0:8752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.477963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803456 00000100:00100000:2.0:1783950884.477969:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803456 00000100:00100000:2.0:1783950884.478004:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783950884.478011:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:8752:x1870607944803456:12345-0@lo:502: 00000100:00100000:2.0:1783950884.478106:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:8752:x1870607944803456:12345-0@lo:502: Request processed in 94us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.478113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783950884.478261:0:8752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8752:1870607944803456:0@lo:502: 00000020:01000000:3.0:1783950884.478285:0:8752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783950884.478292:0:8752:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783950884.478298:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950884.478301:0:8752:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783950884.478305:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783950884.478380:0:8752:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:3.0:1783950884.478404:0:8752:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783950884.478408:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783950884.478422:0:8752:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e037795b380) 00000020:00000080:3.0:1783950884.478443:0:8752:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783950884.478449:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783950884.478559:0:8752:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1783950884.478566:0:8752:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783950884.478574:0:8752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f7e10 00010000:00080000:3.0:1783950884.478601:0:8752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246a33800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783950884.478834:0:8752:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1783950884.487677:0:8752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783950884.487698:0:8752:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1783950884.487918:0:8752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783950884.488183:0:8752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783950884.488293:0:8752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783950884.488386:0:8752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783950884.489184:0:8753:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783950884.489190:0:8753:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783950884.492414:0:8752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783950884.492430:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783950884.492488:0:8752:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783950884.492512:0:8752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7e17 00000100:00080000:3.0:1783950884.492524:0:8752:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783950884.492530:0:8752:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e0246a33800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783950884.492573:0:8752:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d247b80 x1870607944803584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783950884.492611:0:8752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783950884.492657:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944803584:0@lo:8: 00000020:01000000:3.0:1783950884.492672:0:8752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950884.492677:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950884.492680:0:8752:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783950884.492683:0:8752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783950884.492688:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950884.492690:0:8752:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783950884.492693:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783950884.492695:0:8752:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783950884.492725:0:8752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8752:1870607944803712:0@lo:502: 00000100:00100000:1.0:1783950884.492739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.492785:0:8752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.492816:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803712 00000100:00100000:3.0:1783950884.492822:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803712 00000100:00100000:3.0:1783950884.492864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783950884.492872:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:8752:x1870607944803712:12345-0@lo:502: 00000100:00100000:3.0:1783950884.492988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:8752:x1870607944803712:12345-0@lo:502: Request processed in 115us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.492995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783950884.493032:0:8752:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.493050:0:8752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8752:1870607944803712:0@lo:502: 00000020:01000000:3.0:1783950884.493071:0:8752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950884.493075:0:8752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950884.493077:0:8752:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783950884.493080:0:8752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1783950884.493260:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1783950884.493283:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783950884.493293:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.493314:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950884.493323:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783950884.493326:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0343db6000 from 30 10000000:01000000:1.0:1783950884.493329:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783950884.493353:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.493361:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.493371:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950884.493382:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803840:0@lo:101: 00000100:00100000:1.0:1783950884.493409:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.493438:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8540 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.494006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803840 00000100:00100000:3.0:1783950884.494014:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803840 00000100:00100000:3.0:1783950884.494052:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783950884.494059:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944803840:12345-0@lo:101: 00010000:00010000:3.0:1783950884.494077:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950884.494089:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7e1e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.494114:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.494124:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.494133:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2200, rc 0) 00000100:00100000:3.0:1783950884.494201:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944803840:12345-0@lo:101: Request processed in 141us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.494207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783950884.494320:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803840:0@lo:101: 00010000:00010000:2.0:1783950884.494337:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.494351:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950884.494406:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803968:0@lo:501: 00000100:00100000:2.0:1783950884.494436:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.494475:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416300 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.494513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803968 00000100:00100000:3.0:1783950884.494517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803968 00000100:00100000:3.0:1783950884.494546:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783950884.494552:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944803968:12345-0@lo:501: 00000100:00100000:3.0:1783950884.494786:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944803968:12345-0@lo:501: Request processed in 233us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.494793:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783950884.496918:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944803584 00000100:00100000:0.0:1783950884.496929:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944803584 00000100:00100000:0.0:1783950884.496963:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783950884.496970:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607944803584:12345-0@lo:8: 00010000:00080000:0.0:1783950884.496998:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1783950884.497031:0:8439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7e2c 00002000:00100000:0.0:1783950884.497067:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e024667e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783950884.497072:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1783950884.497076:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1783950884.497165:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783950884.497386:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1783950884.497409:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9e024667d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783950884.497493:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607944803584:12345-0@lo:8: Request processed in 521us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.497501:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783950884.497527:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944804096:0@lo:400: 00000100:00100000:0.0:1783950884.497561:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.497583:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944804608:0@lo:400: 00000100:00100000:0.0:1783950884.497602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.497621:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950884.497626:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944804480:0@lo:400: 00000100:00100000:3.0:1783950884.498892:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944804224:0@lo:400: 00000100:00100000:3.0:1783950884.500755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.500814:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944804736:0@lo:400: 00000100:00100000:3.0:1783950884.500847:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.500874:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950884.500880:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944804352:0@lo:400: 00000100:00100000:3.0:1783950884.500919:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.500953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804096 00000100:00100000:3.0:1783950884.500960:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804096 00000100:00100000:3.0:1783950884.500998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804608 00000100:00100000:3.0:1783950884.501001:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804608 00000100:00100000:3.0:1783950884.501010:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804736 00000100:00100000:3.0:1783950884.501013:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804736 00000100:00100000:3.0:1783950884.501022:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804352 00000100:00100000:3.0:1783950884.501024:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804352 00000100:00100000:3.0:1783950884.501037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783950884.501045:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944804096:12345-0@lo:400: 00000100:00100000:3.0:1783950884.501097:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944804096:12345-0@lo:400: Request processed in 53us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.501104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783950884.501119:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783950884.501125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944804608:12345-0@lo:400: 00000100:00100000:3.0:1783950884.501178:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944804608:12345-0@lo:400: Request processed in 52us (3574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.501184:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783950884.501196:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783950884.501202:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944804736:12345-0@lo:400: 00000100:00100000:3.0:1783950884.501234:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944804736:12345-0@lo:400: Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.501240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783950884.501251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783950884.501257:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944804352:12345-0@lo:400: 00000100:00100000:3.0:1783950884.501283:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944804352:12345-0@lo:400: Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.501294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783950884.501330:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b8aa00 x1870607944804352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950884.501342:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944804352:0@lo:400: 00010000:00080000:3.0:1783950884.501351:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b96a00 x1870607944804736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950884.501358:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944804736:0@lo:400: 00000100:00100000:2.0:1783950884.501661:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804224 00000100:00100000:2.0:1783950884.501667:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804224 00000100:00100000:2.0:1783950884.501704:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783950884.501712:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944804224:12345-0@lo:400: 00000100:00100000:2.0:1783950884.501750:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944804224:12345-0@lo:400: Request processed in 38us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.501756:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783950884.501855:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944804224:0@lo:400: 00000100:00100000:0.0:1783950884.501933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783950884.501997:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b89180 x1870607944804096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950884.502008:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944804096:0@lo:400: 00010000:00080000:0.0:1783950884.502031:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b96d80 x1870607944804608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950884.502039:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944804608:0@lo:400: 00010000:00080000:0.0:1783950884.502090:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037d247b80 x1870607944803584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783950894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950884.502100:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783950884.502110:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1783950884.502117:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783950884.502123:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783950884.502126:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246a33800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783950884.502167:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783950884.502173:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944803584:0@lo:8: 00000100:00100000:1.0:1783950884.503849:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944803968:0@lo:501: 00000100:00100000:1.0:1783950884.503912:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944804864:0@lo:503: 00000100:00100000:1.0:1783950884.503990:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.504025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804864 00000100:00100000:1.0:1783950884.504031:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804864 00000100:00100000:1.0:1783950884.504071:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783950884.504079:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944804864:12345-0@lo:503: 00000100:00100000:1.0:1783950884.504208:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944804864:12345-0@lo:503: Request processed in 129us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950884.504225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:1.0:1783950884.504262:0:8753:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783950884.504334:0:8753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 240152191329ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783950884.504341:0:8753:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783950884.505498:0:8754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944804992:0@lo:700: 00000100:00100000:3.0:1783950884.505547:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.505571:0:8754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5240 going to sleep for 11 seconds 00000100:00100000:1.0:1783950884.505795:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804992 00000100:00100000:1.0:1783950884.505801:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804992 00000100:00100000:1.0:1783950884.506768:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783950884.506777:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8754:x1870607944804992:12345-0@lo:700: 00000100:00100000:1.0:1783950884.506810:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1870607944805120:0@lo:700: 00000100:00100000:1.0:1783950884.506845:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.506861:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2f600 going to sleep for 11 seconds 00000100:00100000:1.0:1783950884.506903:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805120 00000100:00100000:1.0:1783950884.506906:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805120 00000100:00100000:1.0:1783950884.506926:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783950884.506930:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1870607944805120:12345-0@lo:700: 00000100:00100000:1.0:1783950884.507032:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8480 going to sleep for 11 seconds 00000100:00100000:1.0:1783950884.507052:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944804864:0@lo:503: 00000100:00100000:2.0:1783950884.508083:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944804480 00000100:00100000:2.0:1783950884.508090:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944804480 00000100:00100000:2.0:1783950884.508130:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783950884.508138:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944804480:12345-0@lo:400: 00000100:00100000:2.0:1783950884.508221:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944804480:12345-0@lo:400: Request processed in 84us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.508228:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783950884.508272:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944804480:0@lo:400: 00000004:00080000:2.0:1783950884.509224:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:3.0:1783950884.509503:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950884.509896:0:8755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8755:1870607944805248:0@lo:502: 00000100:00100000:1.0:1783950884.509975:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.510013:0:8755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8540 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.510068:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805248 00000100:00100000:3.0:1783950884.510074:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805248 00000100:00100000:3.0:1783950884.510120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783950884.510129:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:8755:x1870607944805248:12345-0@lo:502: 00000100:00100000:3.0:1783950884.510271:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:8755:x1870607944805248:12345-0@lo:502: Request processed in 143us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.510278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783950884.510368:0:8755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8755:1870607944805248:0@lo:502: 00000100:00100000:1.0:1783950884.510414:0:8755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8755:1870607944805376:0@lo:502: 00000100:00100000:1.0:1783950884.510447:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.510485:0:8755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.510645:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805376 00000100:00100000:3.0:1783950884.510651:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805376 00000100:00100000:3.0:1783950884.510683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783950884.510689:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:8755:x1870607944805376:12345-0@lo:502: 00000100:00100000:3.0:1783950884.510757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:8755:x1870607944805376:12345-0@lo:502: Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.510770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783950884.510928:0:8755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8755:1870607944805376:0@lo:502: 00000040:00080000:1.0:1783950884.510953:0:8755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1783950884.511115:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1783950884.511135:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783950884.511171:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511183:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950884.511192:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783950884.511195:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0343db6000 from 5 10000000:01000000:3.0:1783950884.511197:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783950884.511222:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511231:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511240:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950884.511252:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805504:0@lo:101: 00000100:00100000:3.0:1783950884.511281:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.511302:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.511314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805504 00000100:00100000:3.0:1783950884.511318:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805504 00000100:00100000:3.0:1783950884.511340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783950884.511346:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944805504:12345-0@lo:101: 00010000:00010000:3.0:1783950884.511354:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950884.511373:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7e33 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511394:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511406:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511414:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3000, rc 0) 00000100:00100000:3.0:1783950884.511441:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944805504:12345-0@lo:101: Request processed in 95us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.511447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783950884.511488:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805504:0@lo:101: 00010000:00010000:3.0:1783950884.511500:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.511509:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950884.511554:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805632:0@lo:256: 00000100:00100000:3.0:1783950884.511584:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.511598:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.511609:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805632 00000100:00100000:3.0:1783950884.511612:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805632 00000100:00100000:3.0:1783950884.511631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783950884.511900:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944805632:12345-0@lo:256: 20000000:01000000:3.0:1783950884.511914:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783950884.511929:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783950884.511936:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783950884.512098:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944805632:12345-0@lo:256: Request processed in 460us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.512106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783950884.516824:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805632:0@lo:256: 10000000:01000000:1.0:1783950884.516895:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783950884.516905:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.516917:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950884.516928:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783950884.516930:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1783950884.516934:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783950884.516969:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.516978:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.516987:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950884.517006:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805760:0@lo:101: 00000100:00100000:1.0:1783950884.517066:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.517162:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.517450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805760 00000100:00100000:3.0:1783950884.517457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805760 00000100:00100000:3.0:1783950884.517666:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783950884.517676:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944805760:12345-0@lo:101: 00010000:00010000:3.0:1783950884.517693:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950884.517706:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7e41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.517729:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.517740:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.517749:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2800, rc 0) 00000100:00100000:3.0:1783950884.517795:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944805760:12345-0@lo:101: Request processed in 120us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.517804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783950884.517863:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805760:0@lo:101: 00010000:00010000:1.0:1783950884.517878:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.517888:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950884.517954:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805888:0@lo:501: 00000100:00100000:1.0:1783950884.517980:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.521667:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.525733:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944805888 00000100:00100000:2.0:1783950884.525749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944805888 00000100:00100000:2.0:1783950884.525815:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783950884.525826:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944805888:12345-0@lo:501: 00000100:00100000:2.0:1783950884.526048:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944805888:12345-0@lo:501: Request processed in 222us (8065us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.526056:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783950884.526309:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944805888:0@lo:501: 00000100:00100000:1.0:1783950884.526364:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944806016:0@lo:503: 00000100:00100000:1.0:1783950884.526413:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.526442:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.526541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806016 00000100:00100000:2.0:1783950884.526545:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806016 00000100:00100000:2.0:1783950884.526563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783950884.526568:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944806016:12345-0@lo:503: 00000100:00100000:2.0:1783950884.526656:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944806016:12345-0@lo:503: Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.526662:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783950884.526737:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944806016:0@lo:503: 40000000:02000000:2.0:1783950884.527172:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1783950884.530357:0:8756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8756:1870607944806144:0@lo:502: 00000100:00100000:3.0:1783950884.530480:0:8756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.530532:0:8756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.532951:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1870607944805120:12345-0@lo:700: Request processed in 26010us (26095us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.532970:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950884.533014:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806144 00000100:00100000:2.0:1783950884.533021:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806144 00000100:00100000:2.0:1783950884.533065:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783950884.533073:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:8756:x1870607944806144:12345-0@lo:502: 00000100:00100000:2.0:1783950884.533229:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:8756:x1870607944806144:12345-0@lo:502: Request processed in 156us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.533236:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783950884.533616:0:8756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8756:1870607944806144:0@lo:502: 00000020:01000000:3.0:1783950884.533650:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783950884.533658:0:8756:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783950884.533671:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950884.533673:0:8756:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783950884.533678:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783950884.533682:0:8756:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:3.0:1783950884.533705:0:8756:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783950884.533708:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783950884.533723:0:8756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e037795cd40) 00000020:00000080:3.0:1783950884.533746:0:8756:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783950884.533752:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783950884.533862:0:8756:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783950884.533868:0:8756:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783950884.533875:0:8756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7e56 00010000:00080000:3.0:1783950884.533904:0:8756:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246421800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783950884.534181:0:8756:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:1.0:1783950884.537011:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0381148e00 x1870607944805120/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950884.537029:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1870607944805120:0@lo:700: 40000000:02000000:1.0:1783950884.537044:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1783950884.543575:0:8756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783950884.543598:0:8756:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783950884.543795:0:8756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783950884.543994:0:8756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783950884.544081:0:8756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783950884.544240:0:8756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:1.0:1783950884.548836:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783950884.548971:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8754:x1870607944804992:12345-0@lo:700: Request processed in 42188us (43417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950884.548983:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783950884.549049:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037d244a80 x1870607944804992/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950884.549068:0:8754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944804992:0@lo:700: 00000040:00080000:3.0:1783950884.549441:0:8757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783950884.549446:0:8757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783950884.550414:0:8756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783950884.550425:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783950884.550474:0:8756:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783950884.550501:0:8756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7e5d 00000100:00080000:2.0:1783950884.550511:0:8756:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783950884.550517:0:8756:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0246421800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783950884.550566:0:8756:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abd180 x1870607944806272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783950884.550591:0:8756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783950884.550652:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950884.550657:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950884.550659:0:8756:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783950884.550662:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950884.550666:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950884.550667:0:8756:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783950884.550670:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783950884.550672:0:8756:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783950884.550699:0:8756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8756:1870607944806400:0@lo:502: 00000100:00100000:2.0:1783950884.550771:0:8756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.550805:0:8756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783950884.550951:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944806272:0@lo:8: 00000100:00100000:1.0:1783950884.550988:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950884.551175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806400 00000100:00100000:3.0:1783950884.551181:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806400 00000100:00100000:3.0:1783950884.551220:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783950884.551229:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:8756:x1870607944806400:12345-0@lo:502: 00000100:00100000:3.0:1783950884.551482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:8756:x1870607944806400:12345-0@lo:502: Request processed in 253us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.551490:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783950884.552439:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806272 00000100:00100000:2.0:1783950884.552448:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806272 00000100:00100000:2.0:1783950884.552499:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950884.552506:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3651:x1870607944806272:12345-0@lo:8: 00010000:00080000:2.0:1783950884.552540:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1783950884.552573:0:8441:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7e64 00002000:00100000:2.0:1783950884.552590:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e02466de800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783950884.552595:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783950884.552599:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783950884.552700:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783950884.552725:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e02466df800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783950884.552800:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607944806272:12345-0@lo:8: Request processed in 293us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.552808:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950884.552866:0:8756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:8756:1870607944806400:0@lo:502: 00000020:01000000:2.0:1783950884.552902:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950884.552907:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950884.552910:0:8756:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783950884.552914:0:8756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1783950884.553040:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1783950884.553063:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783950884.553074:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.553084:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950884.553095:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783950884.553098:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e036d35b380 from 1 10000000:01000000:2.0:1783950884.553100:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783950884.553132:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.553174:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950884.553185:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950884.553203:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944806528:0@lo:101: 00000100:00100000:2.0:1783950884.553236:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.553265:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.554228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806528 00000100:00100000:3.0:1783950884.554244:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806528 00000100:00100000:3.0:1783950884.554283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783950884.554291:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944806528:12345-0@lo:101: 00010000:00010000:3.0:1783950884.554304:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950884.554330:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7e6b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.554358:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.554368:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950884.554377:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3c00, rc 0) 00000100:00100000:3.0:1783950884.554438:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944806528:12345-0@lo:101: Request processed in 148us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.554445:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1783950884.554517:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abd180 x1870607944806272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783950894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950884.554527:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783950884.554535:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783950884.554543:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783950884.554549:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783950884.554553:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246421800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783950884.554564:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783950884.554569:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944806272:0@lo:8: 00000004:00080000:3.0:1783950884.554593:0:8757:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783950884.554669:0:8757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240202526154ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783950884.554683:0:8757:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783950884.555077:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944806528:0@lo:101: 00010000:00010000:1.0:1783950884.555101:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.555111:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950884.555210:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944806656:0@lo:501: 00000100:00100000:1.0:1783950884.555245:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950884.555274:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.556092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806656 00000100:00100000:3.0:1783950884.556099:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806656 00000100:00100000:3.0:1783950884.556136:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783950884.557390:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944806656:12345-0@lo:501: 00000100:00100000:3.0:1783950884.558191:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944806656:12345-0@lo:501: Request processed in 808us (2942us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783950884.558202:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:2.0:1783950884.559259:0:8754:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783950884.559285:0:8754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944806912:0@lo:7: 00000100:00100000:2.0:1783950884.559361:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.559402:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806912 00000100:00100000:2.0:1783950884.559408:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806912 00000100:00100000:2.0:1783950884.559447:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783950884.559454:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8754:x1870607944806912:12345-0@lo:7: 00000100:00100000:0.0:1783950884.562718:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944806784:0@lo:13: 00000100:00100000:0.0:1783950884.562792:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.562872:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944806784 00000100:00100000:0.0:1783950884.562879:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944806784 00000100:00100000:0.0:1783950884.562922:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783950884.562930:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944806784:12345-0@lo:13: 00002000:00000024:0.0:1783950884.562959:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923820544 avail 3692298240 00000100:00100000:0.0:1783950884.563002:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944806784:12345-0@lo:13: Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.563009:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783950884.563048:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abc000 x1870607944806784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950884.563067:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944806784:0@lo:13: 00000004:00080000:3.0:1783950884.566674:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783950884.567456:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944806656:0@lo:501: 10000000:01000000:1.0:1783950884.567532:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783950884.567545:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950884.567559:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950884.568940:0:8754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3300 going to sleep for 11 seconds 00002000:00080000:2.0:1783950884.570227:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783950884.570234:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783950884.570339:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8754:x1870607944806912:12345-0@lo:7: Request processed in 10879us (10972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.570349:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783950884.570403:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abea00 x1870607944806912/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.570417:0:8754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944806912:0@lo:7: 00000004:00080000:2.0:1783950884.570432:0:8754:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783950884.570483:0:8754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944807040:0@lo:5: 00000100:00100000:2.0:1783950884.570520:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.570554:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807040 00000100:00100000:2.0:1783950884.570561:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807040 00000100:00100000:2.0:1783950884.570599:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783950884.570608:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8754:x1870607944807040:12345-0@lo:5: 00002000:00080000:2.0:1783950884.570638:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783950884.570664:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8754:x1870607944807040:12345-0@lo:5: Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.570669:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783950884.570688:0:8754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3300 going to sleep for 11 seconds 00010000:00080000:2.0:1783950884.570699:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abea00 x1870607944807040/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.570722:0:8754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944807040:0@lo:5: 00000004:00080000:2.0:1783950884.570729:0:8754:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783950884.570750:0:8754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944807168:0@lo:5: 00000100:00100000:2.0:1783950884.570772:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.570790:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807168 00000100:00100000:2.0:1783950884.570794:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807168 00000100:00100000:2.0:1783950884.570814:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950884.570819:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8754:x1870607944807168:12345-0@lo:5: 00002000:00080000:2.0:1783950884.570841:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783950884.572424:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8754:x1870607944807168:12345-0@lo:5: Request processed in 1600us (1646us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783950884.572434:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950884.572533:0:8754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3300 going to sleep for 11 seconds 00010000:00080000:2.0:1783950884.572554:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abea00 x1870607944807168/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.572567:0:8754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8754:1870607944807168:0@lo:5: 00000004:00080000:2.0:1783950884.572579:0:8754:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1783950884.572616:0:8754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8754:1870607944807296:0@lo:900: 00000100:00100000:2.0:1783950884.572647:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.572666:0:8754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ddacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950884.572846:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807296 00000100:00100000:0.0:1783950884.572853:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807296 00000100:00100000:0.0:1783950884.572896:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783950884.572904:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8754:x1870607944807296:12345-0@lo:900: 00000100:00100000:0.0:1783950884.572953:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8754:x1870607944807296:12345-0@lo:900: Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.572960:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783950884.573035:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abdc00 x1870607944807296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950884.573044:0:8754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8754:1870607944807296:0@lo:900: 00000004:00080000:0.0:1783950884.575885:0:8758:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783950884.575923:0:8758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807552:0@lo:7: 00000100:00100000:0.0:1783950884.576013:0:8758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.576045:0:8758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.576135:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944807424:0@lo:13: 00000100:00100000:2.0:1783950884.576207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.576250:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807552 00000100:00100000:2.0:1783950884.576257:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807552 00000100:00100000:2.0:1783950884.576328:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783950884.576336:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8758:x1870607944807552:12345-0@lo:7: 00000100:00100000:0.0:1783950884.579654:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807424 00000100:00100000:0.0:1783950884.579667:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807424 00000100:00100000:0.0:1783950884.579731:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783950884.579741:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944807424:12345-0@lo:13: 00002000:00000024:0.0:1783950884.579772:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1783950884.579867:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944807424:12345-0@lo:13: Request processed in 126us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950884.579876:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:2.0:1783950884.580960:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783950884.580968:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783950884.581035:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8758:x1870607944807552:12345-0@lo:7: Request processed in 4698us (5021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950884.581044:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783950884.581085:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950884.581131:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b94700 x1870607944807424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.581175:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944807424:0@lo:13: 00010000:00080000:0.0:1783950884.581529:0:8758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b96a00 x1870607944807552/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950884.581538:0:8758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807552:0@lo:7: 00000004:00080000:0.0:1783950884.581549:0:8758:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783950884.581591:0:8758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807680:0@lo:5: 00000100:00100000:0.0:1783950884.581630:0:8758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950884.581658:0:8758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950884.581913:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807680 00000100:00100000:2.0:1783950884.581920:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807680 00000100:00100000:2.0:1783950884.582007:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783950884.582015:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8758:x1870607944807680:12345-0@lo:5: 00002000:00080000:2.0:1783950884.582037:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783950884.582041:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1783950884.589319:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1783950884.589341:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783950884.589349:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783950884.589589:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8758:x1870607944807680:12345-0@lo:5: Request processed in 7568us (7951us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783950884.589601:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783950884.589689:0:8758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d9880 x1870607944807680/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.589701:0:8758:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783950884.589707:0:8758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807680:0@lo:5: 00000004:00080000:2.0:1783950884.589721:0:8758:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783950884.589771:0:8758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807808:0@lo:700: 00000100:00100000:2.0:1783950884.589825:0:8758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.589868:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807808 00000100:00100000:2.0:1783950884.589873:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807808 00000100:00100000:2.0:1783950884.589908:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783950884.589916:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8758:x1870607944807808:12345-0@lo:700: 00000100:00100000:2.0:1783950884.590047:0:8758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.602983:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8758:x1870607944807808:12345-0@lo:700: Request processed in 13058us (13148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950884.603003:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783950884.603186:0:8758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abed80 x1870607944807808/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.603204:0:8758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807808:0@lo:700: 00000004:02000040:2.0:1783950884.609919:0:8758:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1783950884.614088:0:8758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807936:0@lo:5: 00000100:00100000:2.0:1783950884.614200:0:8758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950884.614248:0:8758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950884.614398:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944807936 00000100:00100000:3.0:1783950884.614405:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944807936 00000100:00100000:3.0:1783950884.614459:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950884.614477:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8758:x1870607944807936:12345-0@lo:5: 00002000:00080000:3.0:1783950884.621108:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783950884.621131:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1783950884.623671:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8758:x1870607944807936:12345-0@lo:5: Request processed in 9188us (9464us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783950884.623684:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783950884.631479:0:8758:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abed80 x1870607944807936/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950884.631503:0:8758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8758:1870607944807936:0@lo:5: 00000004:00080000:2.0:1783950884.631520:0:8758:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1783950884.960307:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783950885.414690:0:8814:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783950885.984263:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783950886.640009:0:8867:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783950886.640240:0:8867:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783950887.008417:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944808064:0@lo:41: 00010000:00010000:1.0:1783950887.008458:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950887.009113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950887.009243:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808064 00000100:00100000:0.0:1783950887.009254:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808064 00000100:00100000:0.0:1783950887.009322:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783950887.009336:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944808064:12345-0@lo:41: 00000004:00000024:0.0:1783950887.009375:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783950887.009468:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944808064:12345-0@lo:41: Request processed in 136us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950887.009474:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783950887.009629:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944808064:0@lo:41: 00000001:00080000:0.0:1783950887.605398:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1783950888.032373:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950889.056290:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950889.056739:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944808192:0@lo:41: 00000100:00100000:1.0:1783950889.056848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950889.057774:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808192 00000100:00100000:0.0:1783950889.057788:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808192 00000100:00100000:0.0:1783950889.057877:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783950889.057889:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944808192:12345-0@lo:41: 00000004:00000024:0.0:1783950889.057942:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783950889.058030:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944808192:12345-0@lo:41: Request processed in 143us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950889.058038:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783950889.058207:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944808192:0@lo:41: 00000100:00100000:3.0:1783950889.569551:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950889.569601:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944808320:0@lo:13: 00000100:00100000:3.0:1783950889.569704:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950889.569916:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808320 00000100:00100000:2.0:1783950889.569928:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808320 00000100:00100000:2.0:1783950889.569996:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783950889.570007:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944808320:12345-0@lo:13: 00002000:00000024:2.0:1783950889.570049:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950889.570115:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944808320:12345-0@lo:13: Request processed in 110us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950889.570123:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783950889.570170:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950889.579719:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944808448:0@lo:400: 00000100:00100000:1.0:1783950889.579834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.579938:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944808960:0@lo:400: 00000100:00100000:1.0:1783950889.579970:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580598:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783950889.580609:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944808576:0@lo:400: 00000100:00100000:1.0:1783950889.580644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580676:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944809088:0@lo:400: 00000100:00100000:1.0:1783950889.580700:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580741:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944808832:0@lo:400: 00000100:00100000:1.0:1783950889.580767:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580786:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944809344:0@lo:400: 00000100:00100000:1.0:1783950889.580808:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580833:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783950889.580839:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944808704:0@lo:400: 00000100:00100000:1.0:1783950889.580862:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580881:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944809216:0@lo:400: 00000100:00100000:1.0:1783950889.580903:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950889.580928:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808960 00000100:00100000:1.0:1783950889.580937:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808960 00000100:00100000:1.0:1783950889.580979:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808704 00000100:00100000:1.0:1783950889.580981:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808704 00010000:00080000:2.0:1783950889.581238:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d9500 x1870607944808320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950889.581251:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783950889.581291:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944808320:0@lo:13: 00000100:00100000:3.0:1783950889.581796:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808576 00000100:00100000:3.0:1783950889.581804:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808576 00000100:00100000:3.0:1783950889.581838:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809088 00000100:00100000:3.0:1783950889.581842:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809088 00000100:00100000:3.0:1783950889.581886:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808832 00000100:00100000:3.0:1783950889.581889:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808832 00000100:00100000:3.0:1783950889.581900:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809216 00000100:00100000:3.0:1783950889.581902:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809216 00000100:00100000:3.0:1783950889.581922:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783950889.581933:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944808576:12345-0@lo:400: 00000100:00100000:3.0:1783950889.582039:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944808576:12345-0@lo:400: Request processed in 106us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950889.582047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783950889.582069:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783950889.582075:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469db480 x1870607944808576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950889.582080:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944809088:12345-0@lo:400: 00000100:00100000:2.0:1783950889.582098:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944808576:0@lo:400: 00000100:00100000:3.0:1783950889.582123:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944809088:12345-0@lo:400: Request processed in 45us (1420us total) trans 0 rc 0/0 00010000:00080000:2.0:1783950889.582128:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d8380 x1870607944809088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950889.582136:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783950889.582164:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944809088:0@lo:400: 00000100:00100000:3.0:1783950889.582180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783950889.582188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944808832:12345-0@lo:400: 00000100:00100000:3.0:1783950889.582232:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944808832:12345-0@lo:400: Request processed in 45us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950889.582239:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783950889.582250:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783950889.582257:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944809216:12345-0@lo:400: 00000100:00100000:3.0:1783950889.582285:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944809216:12345-0@lo:400: Request processed in 29us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950889.582291:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783950889.582310:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783950889.582315:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950889.582369:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809344 00000100:00100000:3.0:1783950889.582380:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809344 00000100:00100000:3.0:1783950889.582430:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783950889.582438:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944809344:12345-0@lo:400: 00000100:00100000:3.0:1783950889.582474:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944809344:12345-0@lo:400: Request processed in 37us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950889.582494:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783950889.582503:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469da300 x1870607944809216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950889.582515:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944809216:0@lo:400: 00000100:00080000:3.0:1783950889.582520:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950889.582530:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d8000 x1870607944808832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950889.582539:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944808832:0@lo:400: 00010000:00080000:2.0:1783950889.582550:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469da680 x1870607944809344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950889.582558:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1783950889.582754:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944809344:0@lo:400: 00000100:00100000:1.0:1783950889.583652:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783950889.583664:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944808960:12345-0@lo:400: 00000100:00100000:1.0:1783950889.583756:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944808960:12345-0@lo:400: Request processed in 94us (3784us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950889.583786:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783950889.583804:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783950889.583810:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944808704:12345-0@lo:400: 00000100:00100000:1.0:1783950889.583845:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944808704:12345-0@lo:400: Request processed in 35us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950889.583851:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950889.584781:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944808960:0@lo:400: 00000100:00100000:3.0:1783950889.585509:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944808704:0@lo:400: 00000100:00100000:0.0:1783950889.587386:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944808448 00000100:00100000:0.0:1783950889.587399:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944808448 00000100:00100000:0.0:1783950889.587473:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783950889.587549:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:3652:x1870607944808448:12345-0@lo:400: 00000100:00100000:0.0:1783950889.588176:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:3652:x1870607944808448:12345-0@lo:400: Request processed in 630us (8341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950889.588196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783950889.588324:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944808448:0@lo:400: 00000020:00000004:2.0:1783950889.645363:0:8968:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783950889.646075:0:8968:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783950890.080326:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950890.082833:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944809472:0@lo:13: 00000100:00100000:1.0:1783950890.082940:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950890.090567:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809472 00000100:00100000:2.0:1783950890.090587:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809472 00000100:00100000:2.0:1783950890.090736:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783950890.090751:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944809472:12345-0@lo:13: 00002000:00000024:2.0:1783950890.090800:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950890.090925:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944809472:12345-0@lo:13: Request processed in 177us (7983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950890.090934:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783950890.091048:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469daa00 x1870607944809472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950890.091075:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944809472:0@lo:13: 00000020:00000004:1.0:1783950890.775331:0:9016:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783950890.775348:0:9016:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1783950891.105456:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950892.129429:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950892.133383:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944809600:0@lo:41: 00000100:00100000:1.0:1783950892.133507:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950892.133610:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809600 00000100:00100000:1.0:1783950892.133621:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809600 00000100:00100000:1.0:1783950892.133677:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783950892.133687:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944809600:12345-0@lo:41: 00000004:00000024:1.0:1783950892.133739:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783950892.133796:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944809600:12345-0@lo:41: Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950892.133822:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783950892.133883:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944809600:0@lo:41: 00010000:00010000:2.0:1783950893.153849:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950894.176662:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950894.177614:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783950894.177638:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944809728:0@lo:41: 00000100:00100000:0.0:1783950894.177702:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.177801:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809728 00000100:00100000:1.0:1783950894.177808:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809728 00000100:00100000:1.0:1783950894.177858:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783950894.177866:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944809728:12345-0@lo:41: 00000004:00000024:1.0:1783950894.178726:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783950894.178797:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944809728:12345-0@lo:41: Request processed in 930us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.178805:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783950894.180138:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944809728:0@lo:41: 00000100:00100000:1.0:1783950894.688491:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944809856:0@lo:400: 00000100:00100000:1.0:1783950894.688579:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688640:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944810368:0@lo:400: 00000100:00100000:1.0:1783950894.688670:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688691:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944810880:0@lo:400: 00000100:00100000:1.0:1783950894.688731:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688761:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783950894.688767:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944810240:0@lo:400: 00000100:00100000:1.0:1783950894.688792:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688808:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944810752:0@lo:400: 00000100:00100000:1.0:1783950894.688828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688855:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944809984:0@lo:400: 00000100:00100000:1.0:1783950894.688879:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688898:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944810496:0@lo:400: 00000100:00100000:1.0:1783950894.688928:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688945:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783950894.688951:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944810112:0@lo:400: 00000100:00100000:1.0:1783950894.688971:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.688987:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944810624:0@lo:400: 00000100:00100000:1.0:1783950894.689007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950894.689034:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810368 00000100:00100000:1.0:1783950894.689041:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810368 00000100:00100000:1.0:1783950894.689078:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810112 00000100:00100000:1.0:1783950894.689081:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810112 00000100:00100000:1.0:1783950894.689098:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783950894.689106:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944810368:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689192:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944810368:12345-0@lo:400: Request processed in 86us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689200:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783950894.689230:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783950894.689236:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944810112:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689270:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944810112:12345-0@lo:400: Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689276:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783950894.689300:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810880 00000100:00100000:1.0:1783950894.689304:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810880 00000100:00100000:1.0:1783950894.689336:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810752 00000100:00100000:1.0:1783950894.689339:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810752 00000100:00100000:1.0:1783950894.689354:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783950894.689360:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944810880:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689401:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944810880:12345-0@lo:400: Request processed in 42us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689414:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783950894.689426:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783950894.689433:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944810752:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689463:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944810752:12345-0@lo:400: Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689468:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783950894.689486:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810240 00000100:00100000:1.0:1783950894.689490:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810240 00000100:00100000:1.0:1783950894.689507:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809984 00000100:00100000:1.0:1783950894.689509:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809984 00000100:00100000:1.0:1783950894.689519:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810496 00000100:00100000:1.0:1783950894.689521:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810496 00000100:00100000:1.0:1783950894.689532:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944810624 00000100:00100000:1.0:1783950894.689534:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944810624 00000100:00100000:1.0:1783950894.689546:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783950894.689552:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944810240:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689583:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944810240:12345-0@lo:400: Request processed in 31us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689589:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783950894.689601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783950894.689607:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944809984:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689632:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944809984:12345-0@lo:400: Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689637:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783950894.689647:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783950894.689653:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944810496:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689678:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944810496:12345-0@lo:400: Request processed in 25us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689689:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783950894.689701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783950894.689707:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944810624:12345-0@lo:400: 00000100:00100000:1.0:1783950894.689734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944810624:12345-0@lo:400: Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950894.689740:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783950894.689768:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783950894.689772:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783950894.689775:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950894.689805:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944810112:0@lo:400: 00010000:00080000:1.0:1783950894.689818:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d8700 x1870607944810624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950894.689828:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944810624:0@lo:400: 00010000:00080000:1.0:1783950894.689838:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d9c00 x1870607944809984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950894.689846:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944809984:0@lo:400: 00010000:00080000:1.0:1783950894.689854:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469db100 x1870607944810496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950894.689861:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944810496:0@lo:400: 00010000:00080000:1.0:1783950894.689895:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469daa00 x1870607944810240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950894.689902:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944810240:0@lo:400: 00010000:00080000:1.0:1783950894.689911:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469da680 x1870607944810752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950894.689925:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944810752:0@lo:400: 00000100:00100000:1.0:1783950894.689935:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944810368:0@lo:400: 00010000:00080000:1.0:1783950894.689943:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d8000 x1870607944810880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950894.689950:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944810880:0@lo:400: 00000100:00100000:0.0:1783950894.690209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944809856 00000100:00100000:0.0:1783950894.690223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944809856 00000100:00100000:0.0:1783950894.690252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783950894.690259:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:3655:x1870607944809856:12345-0@lo:400: 00000100:00100000:0.0:1783950894.690297:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:3655:x1870607944809856:12345-0@lo:400: Request processed in 39us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950894.690304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783950894.691242:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944811008:0@lo:13: 00000100:00100000:2.0:1783950894.691287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950894.691440:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811008 00000100:00100000:0.0:1783950894.691446:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811008 00000100:00100000:0.0:1783950894.691482:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783950894.691489:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944811008:12345-0@lo:13: 00002000:00000024:0.0:1783950894.691519:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950894.691563:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944811008:12345-0@lo:13: Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950894.691569:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783950894.691710:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469da300 x1870607944811008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950894.691730:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944811008:0@lo:13: 00000100:00100000:1.0:1783950894.694813:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944809856:0@lo:400: 00000100:00100000:0.0:1783950895.201834:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944811136:0@lo:13: 00000100:00100000:0.0:1783950895.201933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950895.202010:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811136 00000100:00100000:0.0:1783950895.202018:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811136 00000100:00100000:0.0:1783950895.202064:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783950895.202073:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944811136:12345-0@lo:13: 00002000:00000024:0.0:1783950895.204014:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950895.204122:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944811136:12345-0@lo:13: Request processed in 2048us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950895.204131:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783950895.204338:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d8380 x1870607944811136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950895.204373:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944811136:0@lo:13: 00010000:00010000:2.0:1783950895.205039:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950896.224906:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950897.248499:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783950897.248525:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944811264:0@lo:41: 00000100:00100000:0.0:1783950897.248592:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950897.248658:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811264 00000100:00100000:1.0:1783950897.248666:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811264 00000100:00100000:1.0:1783950897.248721:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783950897.248730:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944811264:12345-0@lo:41: 00010000:00010000:3.0:1783950897.248859:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:1.0:1783950897.248950:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783950897.249008:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944811264:12345-0@lo:41: Request processed in 278us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950897.249016:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783950897.249253:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944811264:0@lo:41: 00010000:00010000:1.0:1783950898.274495:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950899.298315:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950899.299385:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944811392:0@lo:41: 00000100:00100000:0.0:1783950899.299456:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950899.299530:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811392 00000100:00100000:0.0:1783950899.299540:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811392 00000100:00100000:0.0:1783950899.299588:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783950899.299597:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944811392:12345-0@lo:41: 00000004:00000024:0.0:1783950899.299635:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783950899.299682:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944811392:12345-0@lo:41: Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.299690:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783950899.299741:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944811392:0@lo:41: 00000100:00100000:0.0:1783950899.808561:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950899.808600:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944811520:0@lo:13: 00000100:00100000:0.0:1783950899.808709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950899.808794:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811520 00000100:00100000:0.0:1783950899.808804:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811520 00000100:00100000:0.0:1783950899.808902:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783950899.808914:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944811520:12345-0@lo:13: 00002000:00000024:0.0:1783950899.808956:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950899.809012:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944811520:12345-0@lo:13: Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.809022:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783950899.809075:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469d9500 x1870607944811520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950899.809112:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944811520:0@lo:13: 00000100:00080000:2.0:1783950899.809435:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783950899.810133:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944812032:0@lo:400: 00000100:00100000:2.0:1783950899.810220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950899.810253:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944812544:0@lo:400: 00000100:00100000:2.0:1783950899.810280:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950899.810305:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783950899.810312:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944811648:0@lo:400: 00000100:00100000:2.0:1783950899.810354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950899.810389:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944812160:0@lo:400: 00000100:00100000:2.0:1783950899.810416:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950899.811060:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812032 00000100:00100000:3.0:1783950899.811085:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812032 00000100:00100000:3.0:1783950899.811219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783950899.811231:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944812032:12345-0@lo:400: 00000100:00100000:3.0:1783950899.811306:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944812032:12345-0@lo:400: Request processed in 78us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950899.811314:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783950899.811370:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0351b94700 x1870607944812032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950899.811385:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944812032:0@lo:400: 00000100:00100000:3.0:1783950899.811423:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812544 00000100:00100000:3.0:1783950899.811428:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812544 00000100:00100000:3.0:1783950899.812890:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783950899.812907:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944812544:12345-0@lo:400: 00000100:00100000:3.0:1783950899.813003:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944812544:12345-0@lo:400: Request processed in 102us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950899.813026:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783950899.813060:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950899.813114:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0381128380 x1870607944812544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950899.813131:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944812544:0@lo:400: 00000100:00100000:0.0:1783950899.813855:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944811776:0@lo:400: 00000100:00100000:0.0:1783950899.813920:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950899.813955:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944812288:0@lo:400: 00000100:00100000:0.0:1783950899.813983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950899.814010:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783950899.814018:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944811904:0@lo:400: 00000100:00100000:0.0:1783950899.814047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950899.814067:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944812416:0@lo:400: 00000100:00100000:0.0:1783950899.814089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950899.814179:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811648 00000100:00100000:0.0:1783950899.814189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811648 00000100:00100000:0.0:1783950899.814246:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783950899.814257:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:3652:x1870607944811648:12345-0@lo:400: 00000100:00100000:0.0:1783950899.814314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:3652:x1870607944811648:12345-0@lo:400: Request processed in 59us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.814321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783950899.814365:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812160 00000100:00100000:0.0:1783950899.814382:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812160 00000100:00100000:0.0:1783950899.814405:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811904 00000100:00100000:0.0:1783950899.814407:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811904 00000100:00100000:0.0:1783950899.814420:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783950899.814425:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944812160:12345-0@lo:400: 00000100:00100000:0.0:1783950899.814477:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944812160:12345-0@lo:400: Request processed in 51us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.814484:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783950899.814496:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783950899.814502:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944811904:12345-0@lo:400: 00000100:00100000:0.0:1783950899.814535:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944811904:12345-0@lo:400: Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.814541:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783950899.814559:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944811776 00000100:00100000:0.0:1783950899.814562:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944811776 00000100:00100000:0.0:1783950899.814580:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812288 00000100:00100000:0.0:1783950899.814582:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812288 00000100:00100000:0.0:1783950899.814606:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812416 00000100:00100000:0.0:1783950899.814609:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812416 00000100:00100000:0.0:1783950899.814625:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783950899.814630:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944811776:12345-0@lo:400: 00000100:00100000:0.0:1783950899.814662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944811776:12345-0@lo:400: Request processed in 32us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.814668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783950899.814680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950899.814686:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944812288:12345-0@lo:400: 00000100:00100000:0.0:1783950899.814712:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944812288:12345-0@lo:400: Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.814727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950899.814740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783950899.814746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944812416:12345-0@lo:400: 00000100:00100000:0.0:1783950899.814775:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944812416:12345-0@lo:400: Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950899.814780:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783950899.814812:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950899.814816:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950899.814848:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944811904:0@lo:400: 00010000:00080000:0.0:1783950899.814865:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0381128700 x1870607944812416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950899.814875:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944812416:0@lo:400: 00010000:00080000:0.0:1783950899.814886:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abed80 x1870607944811776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950899.814895:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944811776:0@lo:400: 00010000:00080000:0.0:1783950899.814904:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0381128000 x1870607944812288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950899.814911:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944812288:0@lo:400: 00000100:00100000:0.0:1783950899.814956:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944811648:0@lo:400: 00000100:00100000:0.0:1783950899.814970:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944812160:0@lo:400: 00000020:01000004:1.0:1783950900.024621:0:9516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783950900.024628:0:9516:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783950900.024630:0:9516:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783950900.024795:0:9516:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0241aa4000 00000020:01000004:1.0:1783950900.024818:0:9516:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783950900.024838:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783950900.024866:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e0246b44d40) 00000020:00000080:1.0:1783950900.024890:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783950900.121448:0:9516:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783950900.121591:0:9516:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1783950900.154088:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783950900.155563:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783950900.155594:0:9516:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783950900.155610:0:9516:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7645c8e1169f7e80 00000020:01000004:1.0:1783950900.155619:0:9516:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783950900.155650:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783950900.155655:0:9516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783950900.155736:0:9516:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783950900.155778:0:9516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783950900.155784:0:9516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783950900.199673:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783950900.199737:0:9516:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783950900.199742:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783950900.199744:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783950900.199745:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950900.199747:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950900.199748:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950900.199749:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950900.199751:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783950900.199753:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950900.199754:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950900.199756:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950900.199757:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783950900.199761:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783950900.199764:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783950900.199765:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783950900.199766:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950900.199767:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950900.199768:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950900.199769:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950900.199770:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783950900.199771:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950900.199772:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950900.199773:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950900.199775:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783950900.199808:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783950900.199833:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944812672:0@lo:253: 00000100:00100000:1.0:1783950900.199921:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.199992:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03494e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.201670:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812672 00000100:00100000:3.0:1783950900.201690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812672 00000100:00100000:0.0:1783950900.204272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783950900.204316:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:9516:x1870607944812672:12345-0@lo:253: 20000000:01000000:0.0:1783950900.204631:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783950900.204636:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1783950900.204643:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1783950900.204647:0:6517:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1783950900.205136:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783950900.205599:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1783950900.205622:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1783950900.205641:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1783950900.205649:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1783950900.205663:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1783950900.205679:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1783950900.205863:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1783950900.205886:0:6517:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.133@tcp 20000000:01000000:0.0:1783950900.205888:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:0.0:1783950900.205906:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1783950900.205913:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783950900.205929:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1783950900.205935:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:0.0:1783950900.205951:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1783950900.205960:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783950900.205975:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1783950900.205992:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1783950900.206070:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1783950900.206083:0:6517:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.133@tcp 20000000:01000000:0.0:1783950900.206085:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:0.0:1783950900.206100:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1783950900.206106:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783950900.206121:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1783950900.206128:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:0.0:1783950900.206281:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1783950900.206300:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783950900.206329:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1783950900.206352:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1783950900.206914:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1783950900.206933:0:6517:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.133@tcp 20000000:01000000:0.0:1783950900.206935:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.133@tcp (null) (null) (null) 00000040:00080000:0.0:1783950900.206951:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1783950900.206957:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783950900.206970:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1783950900.206976:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.133@tcp (null) (null) 00000040:00080000:0.0:1783950900.206992:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1783950900.207000:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783950900.207014:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1783950900.207033:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1783950900.207048:0:6517:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783950900.207051:0:6517:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783950900.207055:0:6517:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783950900.207106:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783950900.207109:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783950900.208611:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1783950900.208676:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1783950900.208690:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1783950900.209021:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1783950900.209057:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1783950900.209079:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1783950900.209092:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783950900.209095:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783950900.209941:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1783950900.209968:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1783950900.209979:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1783950900.210089:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1783950900.210113:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1783950900.210132:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1783950900.210262:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783950900.210265:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783950900.210634:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1783950900.210652:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1783950900.210661:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1783950900.210792:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1783950900.210805:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1783950900.210813:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1783950900.210821:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783950900.210823:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783950900.211353:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1783950900.211535:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1783950900.211551:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1783950900.211574:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1783950900.211582:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783950900.211584:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783950900.211821:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1783950900.211846:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1783950900.211857:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1783950900.211932:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1783950900.211949:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1783950900.211958:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1783950900.211972:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783950900.211995:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212014:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212028:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212033:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212036:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212040:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212044:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212048:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212053:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212568:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212584:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 21 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.212598:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944812800:0@lo:104: 00000100:00100000:2.0:1783950900.212670:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950900.212810:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212816:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.212823:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944812928:0@lo:104: 00000100:00100000:2.0:1783950900.212838:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950900.212900:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.212908:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 21 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.212917:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813056:0@lo:104: 00000100:00100000:2.0:1783950900.212940:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.212987:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812800 00000100:00100000:0.0:1783950900.212987:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944812928 00000100:00100000:1.0:1783950900.212995:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812800 00000100:00100000:0.0:1783950900.212995:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944812928 00000100:00100000:1.0:1783950900.213052:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783950900.213062:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944812800:12345-0@lo:104: 00000100:00100000:0.0:1783950900.213064:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783950900.213072:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944812928:12345-0@lo:104: 00010000:00010000:1.0:1783950900.213078:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.213079:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.213132:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783950900.213156:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944812928:12345-0@lo:104: Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.213164:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1783950900.213316:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.213337:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.213345:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813184:0@lo:104: 00000100:00100000:2.0:1783950900.213368:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950900.213415:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783950900.213422:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6517:x1870607944812800:12345-0@lo:104: Request processed in 362us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.213437:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1783950900.213555:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.213564:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.213573:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813312:0@lo:104: 00000100:00100000:2.0:1783950900.213604:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.213679:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813056 00000100:00100000:1.0:1783950900.213683:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813056 00000100:00100000:1.0:1783950900.213698:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813184 00000100:00100000:1.0:1783950900.213711:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813184 00000100:00100000:1.0:1783950900.213726:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783950900.213731:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944813056:12345-0@lo:104: 00010000:00010000:1.0:1783950900.213738:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.213767:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783950900.213772:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944813056:12345-0@lo:104: Request processed in 41us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.213777:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783950900.213789:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783950900.213794:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6517:x1870607944813184:12345-0@lo:104: 00010000:00010000:1.0:1783950900.213801:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.213839:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783950900.213843:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6517:x1870607944813184:12345-0@lo:104: Request processed in 50us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.213849:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1783950900.213867:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783950900.213874:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.213881:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950900.213885:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.213895:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950900.213902:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.213907:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950900.213939:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.213946:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950900.213967:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.213976:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e72 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214005:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783950900.214008:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214013:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950900.214016:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214021:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950900.214027:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.214031:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950900.214044:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214051:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950900.214066:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214072:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e48 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214082:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783950900.214084:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214099:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950900.214101:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214107:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950900.214112:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.214117:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950900.214160:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214178:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950900.214184:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214190:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214200:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950900.214203:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214209:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950900.214212:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214227:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950900.214234:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.214240:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950900.214253:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214259:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950900.214264:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214271:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f7dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.214281:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950900.214282:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950900.214284:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950900.214877:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.214890:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 21 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.214902:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813952:0@lo:104: 00000100:00100000:2.0:1783950900.214939:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950900.214997:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215006:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.215014:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944814080:0@lo:104: 00000100:00100000:2.0:1783950900.215036:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47300 going to sleep for 11 seconds 00010000:00010000:0.0:1783950900.215037:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950900.215065:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944812800:0@lo:104: 00000100:00100000:2.0:1783950900.215076:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944812928:0@lo:104: 00000100:00100000:2.0:1783950900.215083:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813056:0@lo:104: 00000100:00100000:2.0:1783950900.215091:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813184:0@lo:104: 00000100:00100000:0.0:1783950900.215110:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944813440:0@lo:103: 00000100:00100000:0.0:1783950900.215162:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.215189:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783950900.215216:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813440 00000100:00100000:2.0:1783950900.215221:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813440 00010000:00010000:2.0:1783950900.215267:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 22 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.215295:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783950900.215304:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+22:3653:x1870607944813440:12345-0@lo:103: 00010000:00010000:2.0:1783950900.215333:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.215340:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 22 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215351:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 22 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215370:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f7e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7e6b expref: 22 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950900.215370:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944813824:0@lo:103: 00010000:00010000:2.0:1783950900.215386:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950900.215413:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+21:3653:x1870607944813440:12345-0@lo:103: Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.215421:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783950900.215456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.215487:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944813440:0@lo:103: 00000100:00100000:0.0:1783950900.215519:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944813568:0@lo:103: 00000100:00100000:0.0:1783950900.215543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.215609:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950900.215615:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944813696:0@lo:103: 00000100:00100000:0.0:1783950900.215639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.215683:0:7466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783950900.215715:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.215725:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813312 00000100:00100000:1.0:1783950900.215728:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813312 00000100:00100000:2.0:1783950900.215740:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813824 00000100:00100000:2.0:1783950900.215743:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813824 00000100:00100000:1.0:1783950900.215748:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813952 00000100:00100000:1.0:1783950900.215750:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813952 00010000:00010000:2.0:1783950900.215755:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.215758:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814080 00000100:00100000:1.0:1783950900.215761:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814080 00000100:00100000:2.0:1783950900.215767:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813568 00000100:00100000:2.0:1783950900.215769:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813568 00000100:00100000:1.0:1783950900.215770:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783950900.215775:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+5:6517:x1870607944813312:12345-0@lo:104: 00010000:00010000:2.0:1783950900.215779:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 22 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.215789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944813696 00000100:00100000:2.0:1783950900.215791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944813696 00010000:00010000:1.0:1783950900.215793:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215799:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 23 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.215810:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783950900.215815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+23:3653:x1870607944813824:12345-0@lo:103: 00010000:00010000:2.0:1783950900.215829:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.215833:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 23 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215842:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 23 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.215843:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783950900.215848:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+5:6517:x1870607944813312:12345-0@lo:104: Request processed in 73us (2244us total) trans 0 rc 0/0 00010000:00010000:2.0:1783950900.215852:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f7e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7dfb expref: 23 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.215854:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1783950900.215862:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950900.215868:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783950900.215873:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944813952:12345-0@lo:104: 00010000:00010000:1.0:1783950900.215880:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.215886:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+22:3653:x1870607944813824:12345-0@lo:103: Request processed in 71us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.215892:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783950900.215905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1783950900.215907:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783950900.215911:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+21:3654:x1870607944813568:12345-0@lo:103: 00000100:00100000:1.0:1783950900.215911:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6517:x1870607944813952:12345-0@lo:104: Request processed in 39us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.215917:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1783950900.215919:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.215923:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215931:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215940:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2800/0x7645c8e1169f7e48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7e41 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.215948:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950900.215951:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783950900.215956:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6517:x1870607944814080:12345-0@lo:104: 00010000:00010000:1.0:1783950900.215963:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.215971:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+20:3654:x1870607944813568:12345-0@lo:103: Request processed in 61us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.215977:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1783950900.215985:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783950900.215988:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6517:x1870607944814080:12345-0@lo:104: Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.215994:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783950900.215995:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783950900.216000:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+19:3654:x1870607944813696:12345-0@lo:103: 00010000:00010000:2.0:1783950900.216008:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.216012:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 19 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.216020:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 19 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216023:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783950900.216028:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.216030:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f7e25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7e1e expref: 19 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.216038:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783950900.216040:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950900.216043:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216051:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950900.216058:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.216064:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783950900.216068:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+18:3654:x1870607944813696:12345-0@lo:103: Request processed in 57us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.216073:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1783950900.216086:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216092:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950900.216102:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216108:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c3c00/0x7645c8e1169f7ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7de6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.216117:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813312:0@lo:104: 00010000:00010000:1.0:1783950900.216118:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783950900.216121:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.216124:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944813952:0@lo:104: 00010000:00010000:1.0:1783950900.216128:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2000 already unused, calling callback (ffffffffc1466c20) 00000100:00100000:2.0:1783950900.216131:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1870607944814080:0@lo:104: 10000000:00010000:1.0:1783950900.216131:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.216179:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216293:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950900.216301:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.216306:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950900.216329:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216335:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950900.216355:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216362:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7da7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216372:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950900.216376:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216381:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950900.216384:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216391:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.216394:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:00010000:1.0:1783950900.216397:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.216404:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944814336:0@lo:103: 10000000:01000000:1.0:1783950900.216408:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950900.216421:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.216430:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.216461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814336 00000100:00100000:2.0:1783950900.216465:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814336 00010000:00010000:2.0:1783950900.216481:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 18 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.216509:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783950900.216515:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+18:3655:x1870607944814336:12345-0@lo:103: 00010000:00010000:2.0:1783950900.216523:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.216527:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 18 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.216536:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 18 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216543:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950900.216546:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f7da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7da0 expref: 18 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216553:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.216554:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783950900.216560:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3a00/0x7645c8e1169f7d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216572:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950900.216574:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950900.216575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+17:3655:x1870607944814336:12345-0@lo:103: Request processed in 60us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1783950900.216576:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950900.216581:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783950900.216596:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944814464:0@lo:103: 00000100:00100000:2.0:1783950900.216616:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.216645:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944814336:0@lo:103: 00000100:00100000:3.0:1783950900.216757:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1783950900.216856:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814464 00000100:00100000:1.0:1783950900.216860:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814464 00010000:00010000:1.0:1783950900.216874:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.216887:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783950900.216893:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+17:3655:x1870607944814464:12345-0@lo:103: 00010000:00010000:1.0:1783950900.216899:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950900.216903:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216911:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216921:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7d76 expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.216937:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950900.216971:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+16:3655:x1870607944814464:12345-0@lo:103: Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.216978:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783950900.217093:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944814464:0@lo:103: 00000100:00100000:1.0:1783950900.217283:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944814208:0@lo:103: 00000100:00100000:1.0:1783950900.217310:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.217350:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944813824:0@lo:103: 00000100:00100000:2.0:1783950900.217373:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814208 00000100:00100000:2.0:1783950900.217378:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814208 00010000:00010000:2.0:1783950900.217393:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 16 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.217416:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783950900.217423:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+16:3653:x1870607944814208:12345-0@lo:103: 00010000:00010000:2.0:1783950900.217438:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.217443:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 16 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217452:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 16 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217463:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7ddf expref: 16 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217477:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217486:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217502:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217510:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217517:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217525:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217531:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783950900.217535:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217554:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217569:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.217579:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950900.217611:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+15:3653:x1870607944814208:12345-0@lo:103: Request processed in 189us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.217618:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783950900.217641:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944814208:0@lo:103: 00010000:00010000:3.0:1783950900.217648:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.217657:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.217664:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7e87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783950900.217681:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783950900.219361:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944813696:0@lo:103: 00000100:00100000:1.0:1783950900.219377:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944813568:0@lo:103: 00010000:00010000:1.0:1783950900.219410:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950900.220965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+14:9516:x1870607944812672:12345-0@lo:253: Request processed in 16669us (21032us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.220982:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783950900.221097:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944812672:0@lo:253: 10000000:01000000:1.0:1783950900.221115:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783950900.221120:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783950900.221121:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783950900.221123:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950900.221124:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783950900.221125:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950900.221127:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950900.221128:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783950900.221130:0:9516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783950900.221132:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950900.221133:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783950900.221368:0:9516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0241aa4000 from lustre-OST0001 10000000:01000000:1.0:1783950900.221401:0:9516:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783950900.221403:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783950900.221414:0:9516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e036d35b380 local copy 10000000:01000000:1.0:1783950900.221417:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783950900.221469:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.221494:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.221506:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.221530:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944814592:0@lo:101: 00000100:00100000:1.0:1783950900.221571:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.221611:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814592 00000100:00100000:1.0:1783950900.221612:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104240 going to sleep for 11 seconds 00000100:00100000:0.0:1783950900.221620:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814592 00000100:00100000:0.0:1783950900.221696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783950900.221769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:9516:x1870607944814592:12345-0@lo:101: 00010000:00010000:0.0:1783950900.221785:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950900.221797:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7e8e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.221820:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7e8e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.221828:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e8e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.221835:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030800, rc 0) 00000100:00100000:0.0:1783950900.221867:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944814592:12345-0@lo:101: Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.221872:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783950900.221892:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944814592:0@lo:101: 00010000:00010000:1.0:1783950900.221906:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.221915:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.222003:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944814720:0@lo:501: 00000100:00100000:1.0:1783950900.222022:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.222065:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104240 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.222089:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814720 00000100:00100000:3.0:1783950900.222092:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814720 00000100:00100000:3.0:1783950900.222120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783950900.222127:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944814720:12345-0@lo:501: 00000100:00100000:3.0:1783950900.222458:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944814720:12345-0@lo:501: Request processed in 329us (432us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783950900.222466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783950900.222539:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944814720:0@lo:501: 10000000:01000000:1.0:1783950900.222552:0:9516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783950900.222571:0:9516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783950900.222577:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.222585:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.222599:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.222628:0:9516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783950900.222662:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0241aa4000 10000000:01000000:1.0:1783950900.222668:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783950900.222673:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783950900.222675:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783950900.222680:0:9516:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783950900.222683:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783950900.222825:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.222833:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.222842:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.222857:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944814848:0@lo:101: 00000100:00100000:1.0:1783950900.222884:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.222947:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814848 00000100:00100000:0.0:1783950900.222953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814848 00010000:00010000:2.0:1783950900.223976:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783950900.223998:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.224016:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783950900.224023:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.224041:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950900.224052:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950900.224063:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783950900.224125:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.224406:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950900.224573:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.224582:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7e8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7645c8e1169f7e95 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.224600:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950900.224602:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950900.224604:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950900.224617:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783950900.224638:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944814976:0@lo:103: 00000100:00100000:2.0:1783950900.224706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.224818:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950900.224867:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944814976 00000100:00100000:2.0:1783950900.224875:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944814976 00000100:00100000:2.0:1783950900.224932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783950900.224943:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+16:3653:x1870607944814976:12345-0@lo:103: 00010000:00010000:2.0:1783950900.224960:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.224980:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7e95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7e8e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.224999:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950900.225079:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+15:3653:x1870607944814976:12345-0@lo:103: Request processed in 138us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.225087:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950900.225399:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944814976:0@lo:103: 00000100:00100000:0.0:1783950900.226543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783950900.226582:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+14:9516:x1870607944814848:12345-0@lo:101: 00010000:00010000:0.0:1783950900.226602:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950900.226624:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7e9c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.226651:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.226660:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.226689:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031c00, rc 0) 00000100:00100000:0.0:1783950900.226769:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944814848:12345-0@lo:101: Request processed in 216us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.226776:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783950900.226801:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944814848:0@lo:101: 00010000:00010000:2.0:1783950900.226821:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.226839:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.226996:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815104:0@lo:501: 00000100:00100000:2.0:1783950900.227035:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.227079:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47300 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.227170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815104 00000100:00100000:3.0:1783950900.227177:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815104 00000100:00100000:2.0:1783950900.227638:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783950900.227651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815104:12345-0@lo:501: 00000100:00100000:2.0:1783950900.227846:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815104:12345-0@lo:501: Request processed in 199us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.227853:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783950900.227919:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815104:0@lo:501: 00000100:00100000:3.0:1783950900.227963:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815232:0@lo:503: 00000100:00100000:3.0:1783950900.228011:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950900.228046:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783950900.228413:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815232 00000100:00100000:0.0:1783950900.228420:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815232 00000100:00100000:0.0:1783950900.228505:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783950900.228516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815232:12345-0@lo:503: 00000100:00100000:0.0:1783950900.228696:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815232:12345-0@lo:503: Request processed in 183us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.228702:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783950900.228788:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815232:0@lo:503: 00000040:00080000:3.0:1783950900.229367:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783950900.229461:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815360:0@lo:502: 00000100:00100000:3.0:1783950900.229512:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950900.229772:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950900.229827:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815360 00000100:00100000:2.0:1783950900.229834:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815360 00000100:00100000:2.0:1783950900.229873:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783950900.229881:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815360:12345-0@lo:502: 00000100:00100000:2.0:1783950900.229997:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815360:12345-0@lo:502: Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.230005:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783950900.230116:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815360:0@lo:502: 00000040:00080000:3.0:1783950900.230435:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783950900.230471:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783950900.230490:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783950900.230506:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783950900.230523:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783950900.230538:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783950900.230822:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815488:0@lo:502: 00000100:00100000:3.0:1783950900.230873:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950900.230892:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950900.230965:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815488 00000100:00100000:2.0:1783950900.230971:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815488 00000100:00100000:2.0:1783950900.231008:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783950900.231016:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815488:12345-0@lo:502: 00000100:00100000:2.0:1783950900.231107:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815488:12345-0@lo:502: Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.231114:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783950900.231123:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815488:0@lo:502: 00000040:00080000:1.0:1783950900.231188:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783950900.231199:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1783950900.231911:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783950900.231922:0:9527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783950900.231930:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950900.231935:0:9527:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783950900.231940:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783950900.231958:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e0246b40000) 00000020:00000080:1.0:1783950900.231983:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783950900.231987:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783950900.232119:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0241aa4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783950900.232125:0:9527:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783950900.232131:0:9527:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7645c8e1169f7eb1 00010000:00010000:2.0:1783950900.237098:0:9527:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1783950900.237770:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783950900.239840:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783950900.240494:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783950900.244733:0:9527:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783950900.244971:0:9527:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783950900.256100:0:9527:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1783950900.258085:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783950900.258101:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950900.258108:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950900.258111:0:9527:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783950900.258121:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783950900.258125:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950900.258127:0:9527:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783950900.258130:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783950900.258132:0:9527:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783950900.258197:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950900.258201:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950900.258203:0:9527:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783950900.258207:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783950900.258659:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1783950900.258698:0:9516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783950900.258786:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.258801:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950900.258811:0:9516:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0241aa4000 from 1 10000000:01000000:1.0:1783950900.258814:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783950900.258874:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.258883:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.258896:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950900.258928:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815616:0@lo:101: 00000100:00100000:1.0:1783950900.259024:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.259081:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104240 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.259395:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815616 00000100:00100000:3.0:1783950900.259404:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815616 00000100:00100000:3.0:1783950900.261025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783950900.261045:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:9516:x1870607944815616:12345-0@lo:101: 00010000:00010000:3.0:1783950900.261065:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950900.261086:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7eb8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.261120:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.261133:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.261157:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2a00, rc 0) 00000100:00100000:3.0:1783950900.261248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944815616:12345-0@lo:101: Request processed in 210us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.261256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783950900.263820:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815616:0@lo:101: 00010000:00010000:2.0:1783950900.263862:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.263878:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.264056:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815744:0@lo:501: 00000100:00100000:2.0:1783950900.264136:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.266912:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1783950900.266979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815744 00000100:00100000:0.0:1783950900.266991:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815744 00000100:00100000:0.0:1783950900.267078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783950900.267091:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944815744:12345-0@lo:501: 00000100:00100000:0.0:1783950900.267851:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944815744:12345-0@lo:501: Request processed in 762us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.267861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783950900.268312:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815744:0@lo:501: 00000100:00100000:2.0:1783950900.268783:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815872:0@lo:503: 00000100:00100000:2.0:1783950900.269534:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.269599:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.270554:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944815872 00000100:00100000:3.0:1783950900.270565:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944815872 00000100:00100000:3.0:1783950900.270629:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783950900.270641:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944815872:12345-0@lo:503: 00000100:00100000:3.0:1783950900.270823:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944815872:12345-0@lo:503: Request processed in 184us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.270833:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783950900.270871:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944815872:0@lo:503: 00000040:00080000:0.0:1783950900.271401:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783950900.271503:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816000:0@lo:502: 00000100:00100000:0.0:1783950900.271554:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.271812:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985840 going to sleep for 11 seconds 00000100:00100000:2.0:1783950900.272192:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816000 00000100:00100000:2.0:1783950900.272200:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816000 00000100:00100000:2.0:1783950900.272248:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783950900.272258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944816000:12345-0@lo:502: 00000100:00100000:2.0:1783950900.272391:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944816000:12345-0@lo:502: Request processed in 134us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.272398:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783950900.272528:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816000:0@lo:502: 00000040:00080000:0.0:1783950900.272841:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783950900.272891:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783950900.272923:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816128:0@lo:502: 00000100:00100000:0.0:1783950900.272963:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.273001:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985840 going to sleep for 11 seconds 00000100:00100000:2.0:1783950900.273126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816128 00000100:00100000:2.0:1783950900.273131:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816128 00000100:00100000:2.0:1783950900.273192:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783950900.273200:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944816128:12345-0@lo:502: 00000100:00100000:2.0:1783950900.273281:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944816128:12345-0@lo:502: Request processed in 82us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.273287:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783950900.274305:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816128:0@lo:502: 00000040:00080000:1.0:1783950900.274417:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783950900.275040:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783950900.278229:0:9531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783950900.278248:0:9531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950900.278251:0:9531:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783950900.278260:0:9531:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0241aa4000 00000020:00000080:1.0:1783950900.278263:0:9531:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783950900.278293:0:9531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783950900.278296:0:9531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950900.278298:0:9531:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783950900.278302:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783950900.278371:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783950900.278805:0:9516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783950900.278925:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.278941:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950900.279006:0:9516:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783950900.279010:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0241aa4000 10000000:01000000:0.0:1783950900.279014:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0241aa4000 10000000:01000000:0.0:1783950900.279018:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783950900.279024:0:9516:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0241aa4000 from 1 10000000:01000000:0.0:1783950900.279027:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783950900.279074:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.279084:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.279097:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950900.279126:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816256:0@lo:101: 00000100:00100000:0.0:1783950900.279509:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.279561:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.280075:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816256 00000100:00100000:3.0:1783950900.280086:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816256 00000100:00100000:3.0:1783950900.280160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783950900.280172:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:9516:x1870607944816256:12345-0@lo:101: 00010000:00010000:3.0:1783950900.280191:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950900.280210:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7ec6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.280243:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.280257:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.280268:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3800, rc 0) 00000100:00100000:3.0:1783950900.280348:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816256:12345-0@lo:101: Request processed in 178us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.280355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783950900.280803:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816256:0@lo:101: 00010000:00010000:0.0:1783950900.280836:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.280847:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950900.280976:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816384:0@lo:501: 00000100:00100000:0.0:1783950900.281012:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.281034:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816384 00000100:00100000:1.0:1783950900.281039:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816384 00000100:00100000:0.0:1783950900.281049:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985600 going to sleep for 11 seconds 00000100:00100000:1.0:1783950900.281076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783950900.281084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816384:12345-0@lo:501: 00000100:00100000:1.0:1783950900.281237:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816384:12345-0@lo:501: Request processed in 153us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.281244:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783950900.281342:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816384:0@lo:501: 00000100:00100000:0.0:1783950900.281372:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816512:0@lo:503: 00000100:00100000:0.0:1783950900.281494:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.281510:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985600 going to sleep for 11 seconds 00000100:00100000:2.0:1783950900.282289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816512 00000100:00100000:2.0:1783950900.282299:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816512 00000100:00100000:2.0:1783950900.282388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783950900.282398:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816512:12345-0@lo:503: 00000100:00100000:2.0:1783950900.282565:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816512:12345-0@lo:503: Request processed in 168us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.282572:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783950900.282653:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816512:0@lo:503: 00000040:00080000:0.0:1783950900.283970:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783950900.284091:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816640:0@lo:502: 00000100:00100000:0.0:1783950900.285624:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.285804:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.285832:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816640 00000100:00100000:3.0:1783950900.285843:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816640 00000100:00100000:3.0:1783950900.285909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783950900.285920:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816640:12345-0@lo:502: 00000100:00100000:3.0:1783950900.286094:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816640:12345-0@lo:502: Request processed in 175us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.286103:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783950900.286130:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816640:0@lo:502: 00000040:00080000:0.0:1783950900.287648:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783950900.287894:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783950900.287918:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783950900.287937:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783950900.287953:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783950900.287971:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783950900.288014:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783950900.288045:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783950900.288064:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783950900.288082:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783950900.288102:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783950900.288122:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783950900.288181:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783950900.289063:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783950900.289097:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783950900.289112:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783950900.289126:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783950900.290505:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783950900.290615:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783950900.290640:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783950900.292308:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783950900.292441:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783950900.292502:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783950900.292527:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783950900.292545:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1783950900.292562:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1783950900.292581:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1783950900.292596:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1783950900.292612:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1783950900.292630:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1783950900.292642:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1783950900.292651:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1783950900.292672:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1783950900.292684:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1783950900.292694:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1783950900.292710:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1783950900.292720:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1783950900.292729:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1783950900.292752:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1783950900.292764:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1783950900.292781:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1783950900.292791:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1783950900.292799:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1783950900.292808:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1783950900.292817:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1783950900.292825:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1783950900.292883:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816768:0@lo:502: 00000100:00100000:0.0:1783950900.292975:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950900.293023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816768 00000100:00100000:0.0:1783950900.293024:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.293033:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816768 00000100:00100000:3.0:1783950900.293136:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783950900.293178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816768:12345-0@lo:502: 00000100:00100000:3.0:1783950900.293348:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944816768:12345-0@lo:502: Request processed in 173us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.293356:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783950900.294843:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944816768:0@lo:502: 00000040:00080000:0.0:1783950900.294951:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1783950900.294980:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1783950900.296618:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783950900.296648:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e0247713380) 00000020:00000080:3.0:1783950900.296682:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1783950900.296881:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0241aa4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783950900.296886:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0241aa4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783950900.296889:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0241aa4000 3 00010000:00080000:3.0:1783950900.296923:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e024770b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783950900.299952:0:9532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783950900.300091:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783950900.300540:0:9532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783950900.300558:0:9532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7645c8e1169f7edb 00000100:00080000:3.0:1783950900.300573:0:9532:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783950900.300581:0:9532:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e024770b800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783950900.300629:0:9532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d246a00 x1870607944816896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783950900.300731:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944816896:0@lo:38: 00000100:00100000:1.0:1783950900.300824:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783950900.300906:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783950900.301021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944816896 00000100:00100000:2.0:1783950900.301029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944816896 00000100:00100000:2.0:1783950900.301075:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783950900.301084:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944816896:12345-0@lo:38: 00010000:00080000:2.0:1783950900.301112:0:6524:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:2.0:1783950900.301186:0:6524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7645c8e1169f7ee2 00000004:00100000:2.0:1783950900.301205:0:6524:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783950900.301243:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9e0246a37000 : changing import state from RECOVER to FULL 00000020:01000004:3.0:1783950900.309743:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783950900.309771:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e0247714d40) 00000020:00000080:3.0:1783950900.309809:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:2.0:1783950900.309903:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1870607944816896:12345-0@lo:38: Request processed in 8813us (9072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.309918:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1783950900.310073:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0241aa4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783950900.310078:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0241aa4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783950900.310081:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0241aa4000 3 00010000:00080000:3.0:1783950900.310124:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e024770d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783950900.315260:0:9532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00080000:0.0:1783950900.316190:0:9534:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9e02469d9c00 x1870607944817024/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1783950900.316835:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783950900.316895:0:9532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783950900.316912:0:9532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7645c8e1169f7ef0 00000100:00080000:3.0:1783950900.316925:0:9532:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783950900.316932:0:9532:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e024770d000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783950900.316964:0:9532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d247480 x1870607944817152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783950900.316981:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783950900.317068:0:9534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 0 seconds 00010000:00080000:1.0:1783950900.317244:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037d246a00 x1870607944816896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950900.317256:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783950900.317268:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783950900.317424:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783950900.317430:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783950900.317435:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783950900.317445:0:3651:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ab51b72e): req@ffff9e02469d9c00 x1870607944817024/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950900.317465:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944816896:0@lo:38: 00000100:00100000:1.0:1783950900.317499:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607944817152:0@lo:38: 00000100:00100000:1.0:1783950900.317586:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.318411:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817152 00000100:00100000:1.0:1783950900.318422:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817152 00000100:00100000:1.0:1783950900.318471:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783950900.318479:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607944817152:12345-0@lo:38: 00010000:00080000:1.0:1783950900.318516:0:6527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1783950900.318558:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7645c8e1169f7ef7 00000004:00100000:1.0:1783950900.318579:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783950900.318619:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9e0247469000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783950900.318693:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1870607944817152:12345-0@lo:38: Request processed in 213us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.318701:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783950900.318777:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037d247480 x1870607944817152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783950910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950900.318787:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783950900.318795:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783950900.318801:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783950900.318806:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783950900.318808:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e024770d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783950900.318814:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607944817152:0@lo:38: 00000100:00100000:0.0:1783950900.320018:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.320108:0:9534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 11 seconds 00000100:00100000:0.0:1783950900.320283:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950900.320298:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944817280:0@lo:13: 00000100:00100000:0.0:1783950900.320343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950900.320413:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817280 00000100:00100000:0.0:1783950900.320422:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817280 00000100:00100000:0.0:1783950900.320843:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783950900.320856:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944817280:12345-0@lo:13: 00002000:00000024:0.0:1783950900.320906:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950900.320964:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944817280:12345-0@lo:13: Request processed in 111us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.320973:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783950900.321040:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02469db800 x1870607944817280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950900.321065:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944817280:0@lo:13: 00010000:00010000:1.0:1783950900.321387:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950900.325907:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817024 00000100:00100000:3.0:1783950900.325926:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817024 00000100:00100000:3.0:1783950900.326021:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950900.326037:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1870607944817024:12345-0@lo:901: 00000100:00100000:3.0:1783950900.326246:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1870607944817024:12345-0@lo:901: Request processed in 215us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.326264:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783950900.326327:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783950900.326563:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00010000:00080000:2.0:1783950900.329479:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d9c00 x1870607944817024/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783950916 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950900.329519:0:9534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1870607944817024:0@lo:901: 00000020:01000000:1.0:1783950900.335411:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1783950900.335496:0:9516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783950900.335527:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.335542:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783950900.335613:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783950900.335616:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783950900.335617:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950900.335618:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950900.335619:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950900.335621:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950900.335623:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783950900.335625:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950900.335626:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950900.335628:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950900.335630:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783950900.335635:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783950900.335638:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783950900.335639:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783950900.335641:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783950900.335642:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783950900.335643:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783950900.335644:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783950900.335645:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783950900.335646:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783950900.335647:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783950900.335649:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783950900.335650:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783950900.335686:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783950900.335713:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944817408:0@lo:253: 00000100:00100000:1.0:1783950900.335814:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950900.335874:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104780 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.335885:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817408 00000100:00100000:3.0:1783950900.335896:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817408 00000100:00100000:3.0:1783950900.335970:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783950900.335980:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944817408:12345-0@lo:253: 20000000:01000000:3.0:1783950900.336015:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783950900.336033:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783950900.344559:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783950900.344652:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783950900.344782:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783950900.344789:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783950900.344820:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.344844:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.344853:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.344862:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.344916:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.344932:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 17 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.344950:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944817536:0@lo:104: 00000100:00100000:2.0:1783950900.345029:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950900.345080:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.345086:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.345094:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944817664:0@lo:104: 00000100:00100000:2.0:1783950900.345121:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.345138:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c540 going to sleep for 11 seconds 00000100:00100000:3.0:1783950900.345186:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817536 00000100:00100000:1.0:1783950900.345228:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817664 00000100:00100000:1.0:1783950900.345233:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817664 00000100:00100000:3.0:1783950900.345255:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817536 00000100:00100000:3.0:1783950900.345392:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783950900.345411:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944817664:12345-0@lo:104: 00000100:00100000:1.0:1783950900.345453:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783950900.345462:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944817536:12345-0@lo:104: 00010000:00010000:3.0:1783950900.345689:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.345751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:9516:x1870607944817408:12345-0@lo:253: Request processed in 9772us (9937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.345762:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783950900.345832:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1065061-5fe9-438e-843f-5f70939080ee:9516:1870607944817408:0@lo:253: 10000000:01000000:2.0:1783950900.345846:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783950900.345849:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783950900.345851:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783950900.345852:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783950900.345853:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783950900.345854:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783950900.345855:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783950900.345857:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783950900.345859:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783950900.345860:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783950900.345863:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783950900.345865:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783950900.345882:0:9516:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783950900.345949:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783950900.345956:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:6541:x1870607944817664:12345-0@lo:104: Request processed in 549us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950900.345962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1783950900.346020:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783950900.346026:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783950900.361088:0:9516:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783950900.361626:0:9516:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783950900.361845:0:9516:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783950900.362035:0:9516:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:1.0:1783950900.363641:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950900.363797:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783950900.363810:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:6541:x1870607944817536:12345-0@lo:104: Request processed in 18345us (18775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950900.363823:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1783950900.363880:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00080000:10000000:2.0:1783950900.364581:0:9516:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783950900.364888:0:9516:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1783950900.366805:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950900.366821:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.366838:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950900.366847:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950900.366852:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950900.366957:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.366963:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950900.366993:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.367022:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7df4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.367022:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783950900.367044:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950900.367047:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950900.367049:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950900.367050:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944817792:0@lo:103: 00000100:00100000:2.0:1783950900.367137:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950900.367260:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944817536:0@lo:104: 00000100:00100000:2.0:1783950900.367274:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1870607944817664:0@lo:104: 00010000:00010000:2.0:1783950900.367312:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950900.368124:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817792 00000100:00100000:3.0:1783950900.368135:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817792 00010000:00010000:3.0:1783950900.368197:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950900.368244:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783950900.368256:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+17:3655:x1870607944817792:12345-0@lo:103: 00010000:00010000:3.0:1783950900.368273:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950900.368280:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.368291:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.368310:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7ded expref: 17 pid: 6520 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.368336:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950900.368414:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+16:3655:x1870607944817792:12345-0@lo:103: Request processed in 160us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950900.368580:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944817792:0@lo:103: 00000100:00100000:3.0:1783950900.368754:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1783950900.368795:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950900.368803:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.368812:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950900.368816:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.368824:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950900.368831:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950900.368837:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783950900.368876:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.368883:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783950900.368907:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.368913:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f7e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7e3a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950900.368928:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950900.368942:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950900.368944:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950900.368949:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950900.368951:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950900.370166:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944817920:0@lo:103: 00000100:00100000:3.0:1783950900.370270:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1783950900.370496:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1783950900.371270:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944817920 00000100:00100000:2.0:1783950900.371375:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944817920 00010000:00010000:2.0:1783950900.371425:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 16 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.371476:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783950900.371486:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+16:3655:x1870607944817920:12345-0@lo:103: 00010000:00010000:2.0:1783950900.371507:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950900.371513:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 16 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371527:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 16 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371547:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3000/0x7645c8e1169f7e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7e33 expref: 16 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371569:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371579:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783950900.371599:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026811474s 00010000:00010000:2.0:1783950900.371604:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371612:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371631:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371639:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371645:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783950900.371650:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371659:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371680:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950900.371693:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783950900.371704:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.371712:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950900.371717:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7efe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950900.371759:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+15:3655:x1870607944817920:12345-0@lo:103: Request processed in 274us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950900.371766:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783950900.371777:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944817920:0@lo:103: 00002000:00080000:2.0:1783950900.400838:0:9516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783950900.400856:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783950900.400909:0:9516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783950900.400971:0:9516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783950900.400998:0:9516:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1783950900.401037:0:9516:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1783950900.402082:0:9516:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783950900.402385:0:9516:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783950901.348948:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783950901.649905:0:9589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783950901.650392:0:9589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783950902.369350:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950902.369488:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950902.369539:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944818048:0@lo:41: 00000100:00100000:1.0:1783950902.369637:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950902.369709:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818048 00000100:00100000:0.0:1783950902.369719:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818048 00000100:00100000:0.0:1783950902.369802:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783950902.369815:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944818048:12345-0@lo:41: 00000004:00000024:0.0:1783950902.369861:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1783950902.369936:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944818048:12345-0@lo:41: Request processed in 124us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950902.369943:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783950902.369997:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944818048:0@lo:41: 00010000:00010000:2.0:1783950903.395631:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950904.417087:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950904.417122:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944818176:0@lo:41: 00000100:00100000:0.0:1783950904.417299:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950904.417376:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818176 00000100:00100000:0.0:1783950904.417385:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818176 00010000:00010000:2.0:1783950904.419820:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950904.426991:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783950904.427018:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944818176:12345-0@lo:41: 00000004:00000024:1.0:1783950904.427202:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783950904.427473:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944818176:12345-0@lo:41: Request processed in 465us (10174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950904.427483:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783950904.430090:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944818176:0@lo:41: 00000100:00100000:0.0:1783950904.931601:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944818304:0@lo:13: 00000100:00100000:0.0:1783950904.931704:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950904.931821:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818304 00000100:00100000:0.0:1783950904.932463:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818304 00000100:00100000:0.0:1783950904.932557:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783950904.932596:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944818304:12345-0@lo:13: 00002000:00000024:0.0:1783950904.932643:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783950904.933690:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783950904.933926:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944818304:12345-0@lo:13: Request processed in 1352us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950904.933942:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783950904.935066:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469daa00 x1870607944818304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950904.935098:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944818304:0@lo:13: 00010000:00010000:0.0:1783950905.440398:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950905.440514:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783950905.440553:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944818432:0@lo:13: 00000100:00100000:2.0:1783950905.440660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.440752:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818432 00000100:00100000:2.0:1783950905.440762:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818432 00000100:00100000:2.0:1783950905.440854:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783950905.440865:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944818432:12345-0@lo:13: 00002000:00000024:2.0:1783950905.440894:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950905.440959:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944818432:12345-0@lo:13: Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.440966:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783950905.440992:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950905.441032:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e038112b800 x1870607944818432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.441054:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944818432:0@lo:13: 00000100:00100000:2.0:1783950905.444056:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944818560:0@lo:400: 00000100:00100000:2.0:1783950905.444184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.444232:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944819072:0@lo:400: 00000100:00100000:2.0:1783950905.444263:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.444297:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944819584:0@lo:400: 00000100:00100000:2.0:1783950905.444323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.444353:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783950905.444360:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944818688:0@lo:400: 00000100:00100000:2.0:1783950905.444382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.444400:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944819200:0@lo:400: 00000100:00100000:2.0:1783950905.444421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.444441:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944819712:0@lo:400: 00000100:00100000:2.0:1783950905.444479:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.444514:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818560 00000100:00100000:2.0:1783950905.444524:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818560 00000100:00100000:2.0:1783950905.444598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783950905.444610:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:3652:x1870607944818560:12345-0@lo:400: 00000100:00100000:2.0:1783950905.444665:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:3652:x1870607944818560:12345-0@lo:400: Request processed in 56us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.444673:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783950905.444708:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819072 00000100:00100000:2.0:1783950905.444712:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819072 00000100:00100000:2.0:1783950905.444736:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783950905.444741:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944819072:12345-0@lo:400: 00000100:00100000:2.0:1783950905.444772:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944819072:12345-0@lo:400: Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.444779:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783950905.444795:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819584 00000100:00100000:2.0:1783950905.444798:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819584 00000100:00100000:2.0:1783950905.444830:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818688 00000100:00100000:2.0:1783950905.444832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818688 00000100:00100000:2.0:1783950905.444844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819200 00000100:00100000:2.0:1783950905.444846:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819200 00000100:00100000:2.0:1783950905.444879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819712 00000100:00100000:2.0:1783950905.444882:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819712 00000100:00100000:2.0:1783950905.444896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783950905.444902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944819584:12345-0@lo:400: 00000100:00100000:2.0:1783950905.444932:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944819584:12345-0@lo:400: Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.444938:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783950905.444961:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783950905.444967:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944818688:12345-0@lo:400: 00000100:00100000:2.0:1783950905.444996:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944818688:12345-0@lo:400: Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445001:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783950905.445011:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783950905.445017:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944819200:12345-0@lo:400: 00000100:00100000:2.0:1783950905.445041:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944819200:12345-0@lo:400: Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445046:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783950905.445056:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783950905.445062:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944819712:12345-0@lo:400: 00000100:00100000:2.0:1783950905.445099:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944819712:12345-0@lo:400: Request processed in 36us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783950905.445170:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944818944:0@lo:400: 00000100:00100000:2.0:1783950905.445198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.445218:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944819456:0@lo:400: 00000100:00100000:2.0:1783950905.445241:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.445263:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783950905.445283:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944818816:0@lo:400: 00000100:00100000:2.0:1783950905.445307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.445325:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944819328:0@lo:400: 00000100:00100000:2.0:1783950905.445346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950905.445374:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819456 00000100:00100000:2.0:1783950905.445378:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819456 00000100:00100000:2.0:1783950905.445418:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950905.445425:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944819456:12345-0@lo:400: 00000100:00100000:2.0:1783950905.445462:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944819456:12345-0@lo:400: Request processed in 37us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445468:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783950905.445491:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818944 00000100:00100000:2.0:1783950905.445495:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818944 00000100:00100000:2.0:1783950905.445514:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819328 00000100:00100000:2.0:1783950905.445517:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819328 00000100:00100000:2.0:1783950905.445540:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950905.445547:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944818944:12345-0@lo:400: 00000100:00100000:2.0:1783950905.445577:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944818944:12345-0@lo:400: Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445583:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950905.445594:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783950905.445600:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944819328:12345-0@lo:400: 00000100:00100000:2.0:1783950905.445626:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944819328:12345-0@lo:400: Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445632:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783950905.445652:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783950905.445657:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783950905.445665:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944818816 00000100:00100000:2.0:1783950905.445668:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944818816 00000100:00100000:2.0:1783950905.445688:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783950905.445694:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944818816:12345-0@lo:400: 00000100:00100000:2.0:1783950905.445724:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944818816:12345-0@lo:400: Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950905.445729:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783950905.445784:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944818816:0@lo:400: 00010000:00080000:2.0:1783950905.445799:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e038112bb80 x1870607944819328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445811:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944819328:0@lo:400: 00010000:00080000:2.0:1783950905.445822:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e038112ad80 x1870607944818944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445831:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944818944:0@lo:400: 00010000:00080000:2.0:1783950905.445841:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0381128700 x1870607944819456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445849:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944819456:0@lo:400: 00010000:00080000:2.0:1783950905.445903:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0381129500 x1870607944818688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445913:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944818688:0@lo:400: 00010000:00080000:2.0:1783950905.445923:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0381129f80 x1870607944819200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445930:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944819200:0@lo:400: 00010000:00080000:2.0:1783950905.445939:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa3100 x1870607944819712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445946:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944819712:0@lo:400: 00000100:00100000:2.0:1783950905.445955:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944818560:0@lo:400: 00000100:00100000:2.0:1783950905.445966:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944819072:0@lo:400: 00010000:00080000:2.0:1783950905.445975:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa3480 x1870607944819584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950905.445991:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944819584:0@lo:400: 00010000:00010000:2.0:1783950906.466631:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783950906.977221:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783950906.977233:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377952800 from 39 10000000:01000000:3.0:1783950906.977240:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783950906.977319:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950906.977333:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950906.977345:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950906.977386:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944819840:0@lo:101: 00000100:00100000:3.0:1783950906.977481:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950906.977562:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47540 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.979171:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819840 00000100:00100000:2.0:1783950906.979186:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819840 00000100:00100000:2.0:1783950906.979250:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783950906.979272:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944819840:12345-0@lo:101: 00010000:00010000:2.0:1783950906.979292:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950906.979314:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.979349:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.979373:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.979383:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c3800, rc 0) 00000100:00100000:2.0:1783950906.979467:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944819840:12345-0@lo:101: Request processed in 207us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.979475:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783950906.979546:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944819840:0@lo:101: 00010000:00010000:2.0:1783950906.979568:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.979578:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950906.979690:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944819968:0@lo:501: 00000100:00100000:2.0:1783950906.979739:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.979770:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.979785:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944819968 00000100:00100000:2.0:1783950906.979789:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944819968 00000100:00100000:2.0:1783950906.979814:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783950906.979820:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944819968:12345-0@lo:501: 00000100:00100000:2.0:1783950906.979962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944819968:12345-0@lo:501: Request processed in 141us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.979969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783950906.979998:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944819968:0@lo:501: 00000100:00100000:2.0:1783950906.980040:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820096:0@lo:503: 00000100:00100000:2.0:1783950906.980080:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.980092:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.980102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820096 00000100:00100000:2.0:1783950906.980106:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820096 00000100:00100000:2.0:1783950906.980125:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783950906.980130:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944820096:12345-0@lo:503: 00000100:00100000:2.0:1783950906.980232:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944820096:12345-0@lo:503: Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.980238:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783950906.980290:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820096:0@lo:503: 00000100:00100000:2.0:1783950906.980536:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9841:1870607944820224:0@lo:502: 00000100:00100000:2.0:1783950906.980572:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.980597:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820224 00000100:00100000:2.0:1783950906.980600:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820224 00000100:00100000:2.0:1783950906.980621:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783950906.980628:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:9841:x1870607944820224:12345-0@lo:502: 00000100:00100000:2.0:1783950906.980704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:9841:x1870607944820224:12345-0@lo:502: Request processed in 76us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.980710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783950906.980740:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da180 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.980751:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9841:1870607944820224:0@lo:502: 00000100:00100000:2.0:1783950906.980792:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9841:1870607944820352:0@lo:502: 00000100:00100000:2.0:1783950906.980823:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.980839:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820352 00000100:00100000:2.0:1783950906.980844:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820352 00000100:00100000:2.0:1783950906.980863:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783950906.980868:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:9841:x1870607944820352:12345-0@lo:502: 00000100:00100000:2.0:1783950906.980922:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:9841:x1870607944820352:12345-0@lo:502: Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.980928:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783950906.980953:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da180 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.980963:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9841:1870607944820352:0@lo:502: 00000040:00080000:2.0:1783950906.980982:0:9841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783950906.981045:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783950906.981064:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783950906.981074:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981085:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950906.981101:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783950906.981105:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1783950906.981108:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783950906.981132:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981165:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981176:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950906.981188:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820480:0@lo:101: 00000100:00100000:2.0:1783950906.981213:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.981227:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da180 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.981239:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820480 00000100:00100000:2.0:1783950906.981242:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820480 00000100:00100000:2.0:1783950906.981275:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783950906.981281:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944820480:12345-0@lo:101: 00010000:00010000:2.0:1783950906.981290:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950906.981303:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f13 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981324:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981336:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981355:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c3c00, rc 0) 00000100:00100000:2.0:1783950906.981382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944820480:12345-0@lo:101: Request processed in 101us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.981388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783950906.981417:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820480:0@lo:101: 00010000:00010000:2.0:1783950906.981429:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950906.981438:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950906.981478:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820608:0@lo:501: 00000100:00100000:2.0:1783950906.981500:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.981512:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da180 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.981522:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820608 00000100:00100000:2.0:1783950906.981524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820608 00000100:00100000:2.0:1783950906.981542:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783950906.981548:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944820608:12345-0@lo:501: 00000100:00100000:2.0:1783950906.981645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944820608:12345-0@lo:501: Request processed in 96us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.981651:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783950906.981677:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820608:0@lo:501: 00000100:00100000:2.0:1783950906.981697:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820736:0@lo:503: 00000100:00100000:2.0:1783950906.981729:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950906.981742:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da180 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.981759:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820736 00000100:00100000:2.0:1783950906.981762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820736 00000100:00100000:2.0:1783950906.981781:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783950906.981786:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944820736:12345-0@lo:503: 00000100:00100000:2.0:1783950906.981848:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944820736:12345-0@lo:503: Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.981855:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783950906.981889:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944820736:0@lo:503: 00000100:00100000:1.0:1783950906.993484:0:9842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9842:1870607944820864:0@lo:502: 00000100:00100000:1.0:1783950906.993605:0:9842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950906.993668:0:9842:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.993813:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820864 00000100:00100000:2.0:1783950906.993822:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820864 00000100:00100000:2.0:1783950906.993881:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783950906.993892:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:9842:x1870607944820864:12345-0@lo:502: 00000100:00100000:2.0:1783950906.994193:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:9842:x1870607944820864:12345-0@lo:502: Request processed in 303us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950906.994202:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783950906.994650:0:9842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9842:1870607944820864:0@lo:502: 00000020:01000000:1.0:1783950906.994687:0:9842:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783950906.994700:0:9842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950906.994703:0:9842:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783950906.994709:0:9842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783950906.994711:0:9842:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783950906.994810:0:9842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9842:1870607944820992:0@lo:502: 00000100:00100000:1.0:1783950906.994857:0:9842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950906.994889:0:9842:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830780 going to sleep for 11 seconds 00000100:00100000:2.0:1783950906.995163:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944820992 00000100:00100000:2.0:1783950906.995169:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944820992 00000100:00100000:3.0:1783950906.995497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783950906.995514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:9842:x1870607944820992:12345-0@lo:502: 00000100:00100000:3.0:1783950906.995654:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:9842:x1870607944820992:12345-0@lo:502: Request processed in 147us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950906.995662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783950906.995820:0:9842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9842:1870607944820992:0@lo:502: 00000020:01000000:1.0:1783950906.995845:0:9842:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783950906.995851:0:9842:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950906.995853:0:9842:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783950906.995858:0:9842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783950906.996217:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783950906.996248:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783950906.996270:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950906.996283:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950906.996294:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783950906.996298:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377b14000 from 39 10000000:01000000:3.0:1783950906.996301:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783950906.996336:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950906.996344:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950906.996354:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950906.996796:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821120:0@lo:101: 00000100:00100000:3.0:1783950906.996844:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950906.996926:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7af00 going to sleep for 11 seconds 00000100:00100000:0.0:1783950907.001009:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821120 00000100:00100000:0.0:1783950907.001089:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821120 00000100:00100000:0.0:1783950907.001203:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783950907.001219:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944821120:12345-0@lo:101: 00010000:00010000:0.0:1783950907.001242:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950907.001274:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f21 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.001310:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.001323:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.001334:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030400, rc 0) 00000100:00100000:0.0:1783950907.001590:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944821120:12345-0@lo:101: Request processed in 376us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.001598:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783950907.001680:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821120:0@lo:101: 00010000:00010000:3.0:1783950907.001702:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950907.001724:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950907.001821:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821248:0@lo:501: 00000100:00100000:3.0:1783950907.001857:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.001936:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.001969:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821248 00000100:00100000:2.0:1783950907.001974:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821248 00000100:00100000:2.0:1783950907.002104:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783950907.002113:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944821248:12345-0@lo:501: 00000100:00100000:2.0:1783950907.002448:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944821248:12345-0@lo:501: Request processed in 336us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.002455:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783950907.002706:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821248:0@lo:501: 00000100:00100000:0.0:1783950907.002748:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821376:0@lo:503: 00000100:00100000:0.0:1783950907.002792:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.002816:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950907.002829:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821376 00000100:00100000:0.0:1783950907.002833:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821376 00000100:00100000:0.0:1783950907.002876:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783950907.002882:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944821376:12345-0@lo:503: 00000100:00100000:0.0:1783950907.002967:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944821376:12345-0@lo:503: Request processed in 85us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.002974:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783950907.003011:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821376:0@lo:503: 00000100:00100000:0.0:1783950907.003279:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9843:1870607944821504:0@lo:502: 00000100:00100000:0.0:1783950907.003316:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.003334:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821504 00000100:00100000:0.0:1783950907.003338:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821504 00000100:00100000:0.0:1783950907.003473:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783950907.003484:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:9843:x1870607944821504:12345-0@lo:502: 00000100:00100000:0.0:1783950907.003574:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:9843:x1870607944821504:12345-0@lo:502: Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.003580:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783950907.003608:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950907.003619:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9843:1870607944821504:0@lo:502: 00000100:00100000:0.0:1783950907.003659:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9843:1870607944821632:0@lo:502: 00000100:00100000:0.0:1783950907.003687:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.003705:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821632 00000100:00100000:0.0:1783950907.003708:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821632 00000100:00100000:0.0:1783950907.003727:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783950907.003733:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:9843:x1870607944821632:12345-0@lo:502: 00000100:00100000:0.0:1783950907.003787:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:9843:x1870607944821632:12345-0@lo:502: Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.003802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783950907.003825:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950907.003836:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9843:1870607944821632:0@lo:502: 00000040:00080000:0.0:1783950907.003852:0:9843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1783950907.004093:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1783950907.004122:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783950907.004133:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.004976:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950907.005002:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783950907.005005:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 6 10000000:01000000:1.0:1783950907.005008:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783950907.005049:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.005058:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.005077:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950907.005097:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821760:0@lo:101: 00000100:00100000:1.0:1783950907.005167:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.005813:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830780 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.009421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821760 00000100:00100000:2.0:1783950907.009441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821760 00000100:00100000:2.0:1783950907.009524:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783950907.009537:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944821760:12345-0@lo:101: 00010000:00010000:2.0:1783950907.009571:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950907.009597:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f2f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.009632:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f2f expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.009646:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f2f expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.009657:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2c00, rc 0) 00000100:00100000:2.0:1783950907.009761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944821760:12345-0@lo:101: Request processed in 227us (4592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.009769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783950907.009928:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821760:0@lo:101: 00010000:00010000:1.0:1783950907.009951:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.009974:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950907.010063:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821888:0@lo:256: 00000100:00100000:1.0:1783950907.010110:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.010176:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830780 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.010505:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944821888 00000100:00100000:3.0:1783950907.010510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944821888 00000100:00100000:3.0:1783950907.010560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783950907.010568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944821888:12345-0@lo:256: 20000000:01000000:3.0:1783950907.010585:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783950907.010606:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783950907.010609:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1783950907.010692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944821888:12345-0@lo:256: Request processed in 124us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.010700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783950907.010791:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944821888:0@lo:256: 10000000:01000000:1.0:1783950907.010843:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783950907.010852:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.010861:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950907.010870:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783950907.010873:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1783950907.010882:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783950907.010907:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.010915:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.010923:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950907.010936:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944822016:0@lo:101: 00000100:00100000:1.0:1783950907.010962:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.010990:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830780 going to sleep for 11 seconds 00000100:00100000:1.0:1783950907.011004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822016 00000100:00100000:1.0:1783950907.011008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822016 00000100:00100000:1.0:1783950907.011176:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783950907.011185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944822016:12345-0@lo:101: 00010000:00010000:1.0:1783950907.011193:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950907.011206:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f3d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.011225:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.011235:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.011242:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145a00, rc 0) 00000100:00100000:1.0:1783950907.011281:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944822016:12345-0@lo:101: Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.011296:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783950907.014779:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944822016:0@lo:101: 00010000:00010000:1.0:1783950907.014819:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.014836:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950907.014943:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944822144:0@lo:501: 00000100:00100000:1.0:1783950907.015019:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.015073:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830780 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.015137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822144 00000100:00100000:3.0:1783950907.015174:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822144 00000100:00100000:3.0:1783950907.015231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783950907.015242:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944822144:12345-0@lo:501: 00000100:00100000:3.0:1783950907.016572:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944822144:12345-0@lo:501: Request processed in 1324us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.016586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783950907.019444:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944822144:0@lo:501: 00000100:00100000:0.0:1783950907.019533:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944822272:0@lo:503: 00000100:00100000:0.0:1783950907.019626:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.019723:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.020739:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822272 00000100:00100000:3.0:1783950907.020750:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822272 00000100:00100000:3.0:1783950907.020822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783950907.020834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944822272:12345-0@lo:503: 00000100:00100000:3.0:1783950907.021093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944822272:12345-0@lo:503: Request processed in 261us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.021102:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783950907.021579:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944822272:0@lo:503: 00000100:00100000:3.0:1783950907.025810:0:9846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9846:1870607944822400:0@lo:502: 00000100:00100000:3.0:1783950907.025919:0:9846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.025973:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822400 00000100:00100000:3.0:1783950907.025982:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822400 00000100:00100000:3.0:1783950907.026039:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783950907.026049:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+20:9846:x1870607944822400:12345-0@lo:502: 00000100:00100000:3.0:1783950907.026235:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+20:9846:x1870607944822400:12345-0@lo:502: Request processed in 186us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.026245:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783950907.026315:0:9846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d83540 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.026342:0:9846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9846:1870607944822400:0@lo:502: 00000020:01000000:3.0:1783950907.030803:0:9846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783950907.030821:0:9846:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783950907.030831:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950907.030834:0:9846:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783950907.030840:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783950907.030847:0:9846:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:3.0:1783950907.030891:0:9846:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783950907.030894:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783950907.030916:0:9846:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e0247710000) 00000020:00000080:3.0:1783950907.031115:0:9846:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783950907.031123:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783950907.031455:0:9846:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783950907.031464:0:9846:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783950907.031488:0:9846:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f7f52 00010000:00080000:3.0:1783950907.031532:0:9846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0247938000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783950907.031789:0:9846:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1783950907.031978:0:9846:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783950907.032002:0:9846:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783950907.032273:0:9846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783950907.032740:0:9846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783950907.032904:0:9846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783950907.032999:0:9846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1783950907.033827:0:9849:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783950907.033834:0:9849:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783950907.041020:0:9846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783950907.041042:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783950907.041107:0:9846:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783950907.041236:0:9846:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7f59 00000100:00080000:2.0:1783950907.041252:0:9846:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783950907.041269:0:9846:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0247938000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783950907.041317:0:9846:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247aa3480 x1870607944822528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783950907.041426:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944822528:0@lo:8: 00000100:00100000:1.0:1783950907.041518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783950907.041599:0:9846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783950907.041667:0:9846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950907.041672:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950907.041683:0:9846:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783950907.041687:0:9846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950907.041691:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950907.041693:0:9846:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783950907.041696:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783950907.041698:0:9846:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783950907.041727:0:9846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9846:1870607944822656:0@lo:502: 00000100:00100000:2.0:1783950907.041776:0:9846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.041794:0:9846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.041909:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944822784:0@lo:400: 00000100:00100000:2.0:1783950907.041942:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.041962:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944823296:0@lo:400: 00000100:00100000:2.0:1783950907.041985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042001:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944823808:0@lo:400: 00000100:00100000:2.0:1783950907.042020:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042040:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783950907.042045:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944822912:0@lo:400: 00000100:00100000:2.0:1783950907.042070:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042087:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944823424:0@lo:400: 00000100:00100000:2.0:1783950907.042107:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042116:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944823936:0@lo:400: 00000100:00100000:2.0:1783950907.042170:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042200:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944823040:0@lo:400: 00000100:00100000:2.0:1783950907.042225:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042236:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944823552:0@lo:400: 00000100:00100000:2.0:1783950907.042255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042290:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783950907.042304:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944823168:0@lo:400: 00000100:00100000:2.0:1783950907.042328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.042345:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944823680:0@lo:400: 00000100:00100000:3.0:1783950907.042468:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822528 00000100:00100000:3.0:1783950907.042478:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822528 00000100:00100000:3.0:1783950907.042516:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823552 00000100:00100000:3.0:1783950907.042519:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823552 00000100:00100000:3.0:1783950907.042582:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783950907.042597:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944823552:12345-0@lo:400: 00000100:00100000:3.0:1783950907.042660:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944823552:12345-0@lo:400: Request processed in 67us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.042667:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783950907.042685:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950907.042689:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1870607944822528:12345-0@lo:8: 00010000:00080000:3.0:1783950907.042717:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1783950907.042756:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f7f60 00002000:00100000:3.0:1783950907.042773:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e0247938800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1783950907.042778:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1783950907.042782:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783950907.042879:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783950907.043218:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1783950907.043250:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e024793e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783950907.043366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783950907.043409:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa3b80 x1870607944823552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.043426:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944823552:0@lo:400: 00000100:00100000:2.0:1783950907.043473:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822784 00000100:00100000:2.0:1783950907.043478:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822784 00000100:00100000:2.0:1783950907.043507:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823296 00000100:00100000:2.0:1783950907.043511:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823296 00000100:00100000:2.0:1783950907.043525:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823808 00000100:00100000:2.0:1783950907.043528:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823808 00000100:00100000:2.0:1783950907.043540:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823424 00000100:00100000:2.0:1783950907.043543:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823424 00000100:00100000:2.0:1783950907.043555:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823936 00000100:00100000:2.0:1783950907.043558:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823936 00000100:00100000:2.0:1783950907.043568:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823040 00000100:00100000:2.0:1783950907.043570:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823040 00000100:00100000:2.0:1783950907.043582:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783950907.043588:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944822784:12345-0@lo:400: 00000100:00100000:2.0:1783950907.043630:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944822784:12345-0@lo:400: Request processed in 42us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.043636:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783950907.043649:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783950907.043654:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944823296:12345-0@lo:400: 00000100:00100000:2.0:1783950907.043679:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944823296:12345-0@lo:400: Request processed in 25us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.043696:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783950907.043707:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783950907.043713:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944823808:12345-0@lo:400: 00000100:00100000:2.0:1783950907.043742:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944823808:12345-0@lo:400: Request processed in 29us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.043747:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783950907.043759:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783950907.043765:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944823424:12345-0@lo:400: 00000100:00100000:2.0:1783950907.043791:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944823424:12345-0@lo:400: Request processed in 27us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.043796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783950907.043806:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783950907.043812:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944823936:12345-0@lo:400: 00000100:00100000:2.0:1783950907.043838:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944823936:12345-0@lo:400: Request processed in 26us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.043843:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783950907.043853:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783950907.043860:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944823040:12345-0@lo:400: 00000100:00100000:2.0:1783950907.043889:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944823040:12345-0@lo:400: Request processed in 30us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.043895:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783950907.043926:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822912 00000100:00100000:2.0:1783950907.043931:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822912 00000100:00100000:2.0:1783950907.043950:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823168 00000100:00100000:2.0:1783950907.043953:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823168 00000100:00100000:2.0:1783950907.043965:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783950907.043978:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944822912:12345-0@lo:400: 00000100:00100000:2.0:1783950907.044011:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944822912:12345-0@lo:400: Request processed in 34us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.044017:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783950907.044028:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783950907.044034:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944823168:12345-0@lo:400: 00000100:00100000:2.0:1783950907.044058:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944823168:12345-0@lo:400: Request processed in 25us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.044064:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783950907.044084:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783950907.044092:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783950907.044683:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944822912:0@lo:400: 00010000:00080000:2.0:1783950907.044699:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa1500 x1870607944823424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.044709:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944823424:0@lo:400: 00010000:00080000:2.0:1783950907.044719:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0381129f80 x1870607944823936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.044727:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944823936:0@lo:400: 00010000:00080000:2.0:1783950907.044739:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa1c00 x1870607944822784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.044747:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944822784:0@lo:400: 00010000:00080000:2.0:1783950907.044757:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa1f80 x1870607944823296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.044766:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944823296:0@lo:400: 00010000:00080000:2.0:1783950907.044789:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e038112b800 x1870607944823808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.044797:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944823808:0@lo:400: 00000100:00100000:2.0:1783950907.044844:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944823168:0@lo:400: 00010000:00080000:2.0:1783950907.044857:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa1880 x1870607944823040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.044865:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944823040:0@lo:400: 00000100:00100000:3.0:1783950907.044941:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607944822528:12345-0@lo:8: Request processed in 2248us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.044957:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950907.044975:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944823680 00000100:00100000:3.0:1783950907.044981:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944823680 00000100:00100000:3.0:1783950907.045011:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950907.045018:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944823680:12345-0@lo:400: 00000100:00100000:3.0:1783950907.045074:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944823680:12345-0@lo:400: Request processed in 56us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.045081:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783950907.045103:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944822656 00000100:00100000:3.0:1783950907.045107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944822656 00000100:00100000:3.0:1783950907.045134:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783950907.045163:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:9846:x1870607944822656:12345-0@lo:502: 00000100:00100000:3.0:1783950907.045310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+20:9846:x1870607944822656:12345-0@lo:502: Request processed in 169us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.045316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00080000:2.0:1783950907.045476:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0381129880 x1870607944823680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.045487:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944823680:0@lo:400: 00000100:00100000:2.0:1783950907.045517:0:9846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9846:1870607944822656:0@lo:502: 00000020:01000000:2.0:1783950907.045548:0:9846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950907.045556:0:9846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950907.045559:0:9846:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783950907.045563:0:9846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1783950907.045704:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1783950907.045730:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783950907.045741:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.045754:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950907.045765:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783950907.045768:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0343db6000 from 39 10000000:01000000:2.0:1783950907.045778:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783950907.045815:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.045823:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.045834:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950907.045855:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824064:0@lo:101: 00000100:00100000:2.0:1783950907.045897:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783950907.046346:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa3480 x1870607944822528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783950917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950907.046417:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783950907.046427:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783950907.046439:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783950907.046446:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783950907.046451:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0247938000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783950907.046500:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783950907.046508:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944822528:0@lo:8: 00000100:00100000:1.0:1783950907.046536:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824064 00000100:00100000:1.0:1783950907.046542:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824064 00000100:00100000:1.0:1783950907.046569:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783950907.046577:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944824064:12345-0@lo:101: 00010000:00010000:1.0:1783950907.046597:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950907.046626:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.046655:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.046667:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.046677:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66800, rc 0) 00000100:00100000:1.0:1783950907.046713:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944824064:12345-0@lo:101: Request processed in 136us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.046719:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783950907.047467:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.047493:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824064:0@lo:101: 00010000:00010000:2.0:1783950907.047511:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.047522:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950907.047598:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824192:0@lo:501: 00000100:00100000:2.0:1783950907.047641:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.047671:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.047758:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824192 00000100:00100000:3.0:1783950907.047764:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824192 00000100:00100000:3.0:1783950907.047800:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783950907.047807:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944824192:12345-0@lo:501: 00000100:00100000:3.0:1783950907.047971:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944824192:12345-0@lo:501: Request processed in 163us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.047978:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1783950907.048017:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783950907.048024:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783950907.048028:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950907.048066:0:9850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944824320:0@lo:700: 00000100:00100000:3.0:1783950907.048097:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.048136:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824320 00000100:00100000:3.0:1783950907.048164:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824320 00000100:00100000:3.0:1783950907.048202:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783950907.048211:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9850:x1870607944824320:12345-0@lo:700: 00000100:00100000:3.0:1783950907.048245:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1870607944824448:0@lo:700: 00000100:00100000:3.0:1783950907.048289:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.048305:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00080000:3.0:1783950907.048315:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783950907.048320:0:9850:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.048472:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824448 00000100:00100000:2.0:1783950907.048476:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824448 00000100:00100000:2.0:1783950907.048506:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783950907.048513:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1870607944824448:12345-0@lo:700: 00000100:00100000:2.0:1783950907.048655:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824192:0@lo:501: 00000100:00100000:2.0:1783950907.048697:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824576:0@lo:503: 00000100:00100000:2.0:1783950907.048737:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.048754:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.048767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824576 00000100:00100000:2.0:1783950907.048771:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824576 00000100:00100000:2.0:1783950907.048794:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783950907.048800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944824576:12345-0@lo:503: 00000100:00100000:2.0:1783950907.048879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944824576:12345-0@lo:503: Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.048886:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783950907.048927:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824576:0@lo:503: 00000004:00080000:0.0:1783950907.049588:0:9849:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783950907.049693:0:9849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 262697550671ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783950907.049702:0:9849:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783950907.051119:0:9852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9852:1870607944824704:0@lo:502: 00000100:00100000:0.0:1783950907.051247:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.051302:0:9852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.051928:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824704 00000100:00100000:2.0:1783950907.051938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824704 00000100:00100000:2.0:1783950907.052004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783950907.052016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:9852:x1870607944824704:12345-0@lo:502: 00000100:00100000:2.0:1783950907.052918:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:9852:x1870607944824704:12345-0@lo:502: Request processed in 898us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.052932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783950907.053020:0:9852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9852:1870607944824704:0@lo:502: 00000100:00100000:2.0:1783950907.053106:0:9852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9852:1870607944824832:0@lo:502: 00000100:00100000:2.0:1783950907.053173:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.053216:0:9852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647480 going to sleep for 11 seconds 00000100:00100000:1.0:1783950907.053302:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824832 00000100:00100000:1.0:1783950907.053309:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824832 00000100:00100000:1.0:1783950907.053354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783950907.053651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:9852:x1870607944824832:12345-0@lo:502: 00000100:00100000:1.0:1783950907.053789:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:9852:x1870607944824832:12345-0@lo:502: Request processed in 141us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.053797:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783950907.054944:0:9852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9852:1870607944824832:0@lo:502: 00000040:00080000:2.0:1783950907.054993:0:9852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000004:00080000:3.0:1783950907.056283:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:1.0:1783950907.062295:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:0.0:1783950907.064588:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783950907.064647:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783950907.064663:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.064679:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950907.064691:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783950907.064695:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0343db6000 from 6 10000000:01000000:0.0:1783950907.064698:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783950907.064756:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.064786:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.064801:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950907.064834:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824960:0@lo:101: 00000100:00100000:0.0:1783950907.064925:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.064987:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.065083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944824960 00000100:00100000:2.0:1783950907.065516:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944824960 00000100:00100000:2.0:1783950907.065579:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783950907.065590:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944824960:12345-0@lo:101: 00010000:00010000:2.0:1783950907.065608:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950907.065626:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7f7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f75 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.065659:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f75 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.065671:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f75 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.065681:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2400, rc 0) 00000100:00100000:2.0:1783950907.065742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944824960:12345-0@lo:101: Request processed in 153us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.065750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783950907.065825:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944824960:0@lo:101: 00010000:00010000:2.0:1783950907.065842:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.065852:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950907.065911:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825088:0@lo:256: 00000100:00100000:2.0:1783950907.065944:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.065967:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.065982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825088 00000100:00100000:2.0:1783950907.065986:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825088 00000100:00100000:2.0:1783950907.066017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783950907.066078:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944825088:12345-0@lo:256: 20000000:01000000:2.0:1783950907.066096:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783950907.066205:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783950907.066209:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783950907.066302:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944825088:12345-0@lo:256: Request processed in 279us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.066310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783950907.066342:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825088:0@lo:256: 10000000:01000000:2.0:1783950907.066520:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783950907.066528:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.066537:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950907.066545:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783950907.066547:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1783950907.066551:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783950907.066589:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.066598:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.066608:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950907.066622:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825216:0@lo:101: 00000100:00100000:2.0:1783950907.066657:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.066724:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783950907.073950:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1870607944824448:12345-0@lo:700: Request processed in 25425us (25648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.073970:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783950907.074053:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d244700 x1870607944824448/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950907.074071:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1870607944824448:0@lo:700: 40000000:02000000:1.0:1783950907.074263:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1783950907.075510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825216 00000100:00100000:0.0:1783950907.075526:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825216 00000100:00100000:0.0:1783950907.075636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783950907.075652:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944825216:12345-0@lo:101: 00010000:00010000:0.0:1783950907.075672:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950907.075697:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7f83 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.075737:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.075749:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.075759:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030800, rc 0) 00000100:00100000:0.0:1783950907.075953:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944825216:12345-0@lo:101: Request processed in 307us (9294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.075960:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783950907.077334:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825216:0@lo:101: 00010000:00010000:3.0:1783950907.077367:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950907.077380:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950907.077557:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825344:0@lo:501: 00000100:00100000:3.0:1783950907.077957:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.078003:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783950907.078801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825344 00000100:00100000:0.0:1783950907.078824:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825344 00000100:00100000:0.0:1783950907.079079:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783950907.079094:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944825344:12345-0@lo:501: 00000100:00100000:0.0:1783950907.080862:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944825344:12345-0@lo:501: Request processed in 1763us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.080877:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783950907.081061:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825344:0@lo:501: 00000100:00100000:2.0:1783950907.083842:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825472:0@lo:503: 00000100:00100000:2.0:1783950907.083951:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.083999:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000001:00100000:0.0:1783950907.086071:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783950907.087074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825472 00000100:00100000:1.0:1783950907.087091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825472 00000100:00100000:1.0:1783950907.087851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783950907.087867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944825472:12345-0@lo:503: 00000100:00100000:1.0:1783950907.088270:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944825472:12345-0@lo:503: Request processed in 395us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.088280:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783950907.088513:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944825472:0@lo:503: 00000100:00100000:1.0:1783950907.088881:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9850:x1870607944824320:12345-0@lo:700: Request processed in 40669us (40780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.088892:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783950907.088982:0:9850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d246680 x1870607944824320/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.088995:0:9850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944824320:0@lo:700: 00000100:00100000:1.0:1783950907.089340:0:9856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9856:1870607944825600:0@lo:502: 00000100:00100000:1.0:1783950907.089457:0:9856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.089510:0:9856:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.089572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825600 00000100:00100000:3.0:1783950907.089581:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825600 00000100:00100000:3.0:1783950907.089722:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783950907.089741:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:9856:x1870607944825600:12345-0@lo:502: 00000100:00100000:3.0:1783950907.089875:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:9856:x1870607944825600:12345-0@lo:502: Request processed in 135us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.089882:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783950907.092535:0:9856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9856:1870607944825600:0@lo:502: 00000020:01000000:1.0:1783950907.092592:0:9856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783950907.092614:0:9856:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783950907.092622:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950907.092625:0:9856:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783950907.092631:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783950907.092636:0:9856:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:1.0:1783950907.092670:0:9856:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783950907.092673:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783950907.092692:0:9856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e0246b419c0) 00000020:00000080:1.0:1783950907.093084:0:9856:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1783950907.093097:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783950907.093290:0:9856:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783950907.093303:0:9856:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783950907.093313:0:9856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f7f98 00010000:00080000:1.0:1783950907.093467:0:9856:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246424800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1783950907.094088:0:9856:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1783950907.094593:0:9856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783950907.094614:0:9856:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783950907.095062:0:9856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783950907.095871:0:9856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783950907.096026:0:9856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783950907.096180:0:9856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:2.0:1783950907.104108:0:9850:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783950907.104176:0:9850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944825856:0@lo:7: 00000100:00100000:2.0:1783950907.104280:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.104340:0:9850:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.104460:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944825728:0@lo:13: 00000100:00100000:2.0:1783950907.104493:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.104543:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825728 00000100:00100000:2.0:1783950907.104553:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825728 00000100:00100000:2.0:1783950907.104614:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783950907.104624:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944825728:12345-0@lo:13: 00002000:00000024:2.0:1783950907.104665:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1783950907.104720:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944825728:12345-0@lo:13: Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.104977:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783950907.105089:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4c000 x1870607944825728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.105206:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944825728:0@lo:13: 00000100:00100000:1.0:1783950907.105327:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825856 00000100:00100000:1.0:1783950907.105334:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825856 00000100:00100000:1.0:1783950907.105439:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783950907.105449:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9850:x1870607944825856:12345-0@lo:7: 00000040:00080000:3.0:1783950907.108539:0:9858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783950907.108554:0:9858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783950907.111625:0:9856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783950907.111644:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783950907.111693:0:9856:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783950907.112842:0:9856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7f9f 00000100:00080000:2.0:1783950907.112863:0:9856:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783950907.112872:0:9856:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0246424800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783950907.112918:0:9856:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247a4c000 x1870607944825984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783950907.112953:0:9856:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783950907.113184:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944825984:0@lo:8: 00000020:01000000:2.0:1783950907.113550:0:9856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950907.113560:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950907.113563:0:9856:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783950907.113567:0:9856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950907.113572:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950907.113574:0:9856:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783950907.113577:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783950907.113579:0:9856:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783950907.113613:0:9856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9856:1870607944826112:0@lo:502: 00000100:00100000:1.0:1783950907.113683:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.113746:0:9856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.113854:0:9856:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783950907.113938:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826112 00000100:00100000:1.0:1783950907.113946:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826112 00000100:00100000:1.0:1783950907.114055:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783950907.114066:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:9856:x1870607944826112:12345-0@lo:502: 00000100:00100000:1.0:1783950907.114278:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:9856:x1870607944826112:12345-0@lo:502: Request processed in 212us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950907.114287:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00002000:00080000:2.0:1783950907.117787:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783950907.117803:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783950907.117925:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9850:x1870607944825856:12345-0@lo:7: Request processed in 12473us (13639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.117938:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783950907.118006:0:9850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4c700 x1870607944825856/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.118908:0:9850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944825856:0@lo:7: 00000004:00080000:2.0:1783950907.118929:0:9850:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783950907.118985:0:9850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944826240:0@lo:5: 00000100:00100000:2.0:1783950907.119526:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.119576:0:9850:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.119579:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944825984 00000100:00100000:3.0:1783950907.119590:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944825984 00000100:00100000:2.0:1783950907.119596:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826240 00000100:00100000:2.0:1783950907.119598:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826240 00000100:00100000:2.0:1783950907.119643:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783950907.119651:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1870607944825984:12345-0@lo:8: 00010000:00080000:2.0:1783950907.119688:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1783950907.119792:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f7fa6 00002000:00100000:2.0:1783950907.119812:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e024746d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783950907.119818:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783950907.119821:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783950907.119915:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783950907.119946:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e0247468000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783950907.120167:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783950907.120196:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607944825984:12345-0@lo:8: Request processed in 542us (6512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.120203:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783950907.120206:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9850:x1870607944826240:12345-0@lo:5: 00000100:00100000:2.0:1783950907.120245:0:9856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:9856:1870607944826112:0@lo:502: 00000020:01000000:2.0:1783950907.120295:0:9856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950907.120303:0:9856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950907.120306:0:9856:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783950907.120311:0:9856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:1.0:1783950907.120451:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4c000 x1870607944825984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783950917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950907.120463:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783950907.120472:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783950907.120481:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783950907.120496:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783950907.120499:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246424800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783950907.120513:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783950907.120519:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944825984:0@lo:8: 00000004:00080000:3.0:1783950907.120522:0:9858:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783950907.120595:0:9858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 262768452151ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783950907.120612:0:9858:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1783950907.122239:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1783950907.122297:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783950907.122322:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950907.122338:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950907.122350:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783950907.122353:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e036d35b380 from 1 00002000:00080000:0.0:1783950907.122422:0:9851:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 10000000:01000000:2.0:1783950907.122486:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783950907.122534:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950907.122539:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9850:x1870607944826240:12345-0@lo:5: Request processed in 2359us (3009us total) trans 0 rc 0/0 00010000:00010000:2.0:1783950907.122543:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950907.122550:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783950907.122554:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950907.122578:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944826368:0@lo:101: 00000100:00100000:2.0:1783950907.122624:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.122671:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03506479c0 going to sleep for 11 seconds 00010000:00080000:2.0:1783950907.122708:0:9850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4c700 x1870607944826240/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.122733:0:9850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944826240:0@lo:5: 00000004:00080000:2.0:1783950907.122746:0:9850:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783950907.122778:0:9850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944826496:0@lo:5: 00000100:00100000:2.0:1783950907.122802:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.122818:0:9850:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.122841:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826496 00000100:00100000:2.0:1783950907.122848:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826496 00000100:00100000:0.0:1783950907.122862:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826368 00000100:00100000:0.0:1783950907.122866:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826368 00000100:00100000:2.0:1783950907.122899:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783950907.122909:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9850:x1870607944826496:12345-0@lo:5: 00000100:00100000:0.0:1783950907.122911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783950907.122917:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944826368:12345-0@lo:101: 00010000:00010000:0.0:1783950907.122926:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950907.122942:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f7fad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783950907.122948:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00010000:0.0:1783950907.122979:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.123508:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.123520:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031800, rc 0) 00000100:00100000:0.0:1783950907.123570:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944826368:12345-0@lo:101: Request processed in 652us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950907.123576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783950907.124749:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944826368:0@lo:101: 00010000:00010000:0.0:1783950907.124780:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950907.124792:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950907.124888:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944826624:0@lo:501: 00000100:00100000:0.0:1783950907.124945:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.125159:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c240 going to sleep for 11 seconds 00000100:00100000:1.0:1783950907.125581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826624 00000100:00100000:1.0:1783950907.125589:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826624 00000100:00100000:1.0:1783950907.125691:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783950907.125702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944826624:12345-0@lo:501: 00000100:00100000:1.0:1783950907.125826:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944826624:12345-0@lo:501: Request processed in 125us (880us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783950907.125834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783950907.126103:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944826624:0@lo:501: 10000000:01000000:1.0:1783950907.126574:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783950907.126587:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950907.126600:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783950907.126838:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783950907.130649:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944826752:0@lo:13: 00000100:00100000:0.0:1783950907.130762:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.135582:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826752 00000100:00100000:2.0:1783950907.135600:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826752 00000100:00100000:2.0:1783950907.135737:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783950907.135751:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944826752:12345-0@lo:13: 00002000:00000024:2.0:1783950907.135787:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:2.0:1783950907.135904:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944826752:12345-0@lo:13: Request processed in 157us (5142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950907.135912:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783950907.136065:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03811b9c00 x1870607944826752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.136092:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944826752:0@lo:13: 00000100:00100000:2.0:1783950907.136471:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9850:x1870607944826496:12345-0@lo:5: Request processed in 13448us (13553us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783950907.136481:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783950907.136519:0:9850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4c700 x1870607944826496/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.136533:0:9850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9850:1870607944826496:0@lo:5: 00000004:00080000:2.0:1783950907.136549:0:9850:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783950907.136602:0:9850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9850:1870607944826880:0@lo:900: 00000100:00100000:2.0:1783950907.136644:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950907.136671:0:9850:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350647900 going to sleep for 11 seconds 00000100:00080000:3.0:1783950907.136976:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783950907.136994:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944826880 00000100:00100000:3.0:1783950907.137000:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944826880 00000100:00100000:3.0:1783950907.137091:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000004:00080000:1.0:1783950907.137225:0:9859:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783950907.137233:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9850:x1870607944826880:12345-0@lo:900: 00000100:00100000:1.0:1783950907.137253:0:9859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827008:0@lo:7: 00000100:00100000:1.0:1783950907.137293:0:9859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.137342:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9850:x1870607944826880:12345-0@lo:900: Request processed in 243us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.137348:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783950907.137381:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827008 00000100:00100000:3.0:1783950907.137385:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827008 00000100:00100000:3.0:1783950907.137412:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783950907.137418:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9859:x1870607944827008:12345-0@lo:7: 00000100:00100000:1.0:1783950907.137492:0:9859:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3d80 going to sleep for 11 seconds 00010000:00080000:2.0:1783950907.141279:0:9850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4ed80 x1870607944826880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950907.141306:0:9850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9850:1870607944826880:0@lo:900: 00002000:00080000:3.0:1783950907.147291:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783950907.147304:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783950907.147879:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9859:x1870607944827008:12345-0@lo:7: Request processed in 10451us (10575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.147894:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1783950907.148548:0:9859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03811b9180 x1870607944827008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950907.148569:0:9859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827008:0@lo:7: 00000004:00080000:0.0:1783950907.148590:0:9859:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783950907.148651:0:9859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827136:0@lo:5: 00000100:00100000:0.0:1783950907.148705:0:9859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950907.148747:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827136 00000100:00100000:0.0:1783950907.148755:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827136 00000100:00100000:0.0:1783950907.148837:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783950907.148849:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9859:x1870607944827136:12345-0@lo:5: 00002000:00080000:0.0:1783950907.148897:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783950907.148902:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783950907.152516:0:9859:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c240 going to sleep for 11 seconds 00000001:00080000:1.0:1783950907.161675:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1783950907.161703:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1783950907.161710:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783950907.161965:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9859:x1870607944827136:12345-0@lo:5: Request processed in 13106us (13247us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783950907.161979:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783950907.162701:0:9859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469db800 x1870607944827136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950907.162735:0:9859:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783950907.162746:0:9859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827136:0@lo:5: 00000004:00080000:1.0:1783950907.162768:0:9859:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783950907.162841:0:9859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827264:0@lo:700: 00000100:00100000:1.0:1783950907.162896:0:9859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.162945:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827264 00000100:00100000:1.0:1783950907.162953:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827264 00000100:00100000:1.0:1783950907.163010:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783950907.163033:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9859:x1870607944827264:12345-0@lo:700: 00000100:00100000:1.0:1783950907.163284:0:9859:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1783950907.183121:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9859:x1870607944827264:12345-0@lo:700: Request processed in 20077us (20199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.183157:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783950907.183497:0:9859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03811b9180 x1870607944827264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950907.183536:0:9859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827264:0@lo:700: 00000004:02000040:1.0:1783950907.188852:0:9859:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1783950907.197515:0:9859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827392:0@lo:5: 00000100:00100000:1.0:1783950907.197618:0:9859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950907.198631:0:9859:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783950907.204577:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827392 00000100:00100000:2.0:1783950907.204598:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827392 00000100:00100000:2.0:1783950907.204677:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783950907.204691:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9859:x1870607944827392:12345-0@lo:5: 00002000:00080000:3.0:1783950907.214130:0:9851:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1783950907.214471:0:9851:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1783950907.221661:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9859:x1870607944827392:12345-0@lo:5: Request processed in 16961us (24030us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783950907.221676:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783950907.222084:0:9859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03811ba300 x1870607944827392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783950923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950907.222182:0:9859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9859:1870607944827392:0@lo:5: 00000004:00080000:0.0:1783950907.222252:0:9859:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:3.0:1783950907.399735:0:9890:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783950907.489485:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944827520:0@lo:41: 00000100:00100000:3.0:1783950907.489571:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950907.489650:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827520 00000100:00100000:3.0:1783950907.489658:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827520 00000100:00100000:3.0:1783950907.489710:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950907.489718:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944827520:12345-0@lo:41: 00000004:00000024:3.0:1783950907.489787:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783950907.489839:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944827520:12345-0@lo:41: Request processed in 121us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950907.489845:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950907.489888:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944827520:0@lo:41: 00010000:00010000:0.0:1783950907.490814:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783950908.370274:0:9942:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783950908.370528:0:9942:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783950908.516222:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950909.538325:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950909.538360:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944827648:0@lo:41: 00000100:00100000:0.0:1783950909.538463:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950909.538548:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827648 00000100:00100000:0.0:1783950909.538558:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827648 00000100:00100000:0.0:1783950909.538635:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783950909.538648:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944827648:12345-0@lo:41: 00000004:00000024:0.0:1783950909.538699:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783950909.538749:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944827648:12345-0@lo:41: Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950909.538757:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783950909.538817:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944827648:0@lo:41: 00010000:00010000:2.0:1783950909.543377:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783950909.550292:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1783950910.048479:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944827776:0@lo:13: 00000100:00100000:2.0:1783950910.048584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950910.048729:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827776 00000100:00100000:3.0:1783950910.048741:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827776 00000100:00100000:3.0:1783950910.048836:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783950910.048852:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944827776:12345-0@lo:13: 00002000:00000024:3.0:1783950910.048896:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783950910.049057:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950910.062684:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944827776:12345-0@lo:13: Request processed in 13820us (14082us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950910.062730:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783950910.071274:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abed80 x1870607944827776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950910.071320:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944827776:0@lo:13: 00000100:00100000:3.0:1783950910.560703:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950910.560741:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944827904:0@lo:13: 00000100:00100000:3.0:1783950910.560861:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950910.561387:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944827904 00000100:00100000:2.0:1783950910.561399:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944827904 00000100:00100000:2.0:1783950910.561497:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783950910.561508:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944827904:12345-0@lo:13: 00002000:00000024:2.0:1783950910.561539:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950910.561607:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944827904:12345-0@lo:13: Request processed in 99us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950910.561615:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783950910.561677:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d246680 x1870607944827904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950910.561700:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944827904:0@lo:13: 00000100:00080000:3.0:1783950910.561892:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783950910.566394:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783950911.422872:0:10043:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950911.423111:0:10043:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783950911.584581:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783950912.297847:0:10091:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783950912.297855:0:10091:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1783950912.579754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950912.580928:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923806336 00000100:00100000:0.0:1783950912.580945:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923806336 00000100:00100000:0.0:1783950912.581084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 181 00000100:00100000:0.0:1783950912.581096:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1870607923806336:12345-192.168.202.33@tcp:250: 00010000:00080000:0.0:1783950912.581138:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 5701fad6-85e7-4cf7-a012-ad03629e43ea@192.168.202.33@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1783950912.581246:0:6517:0:(genops.c:1406:class_connect()) connect: client 5701fad6-85e7-4cf7-a012-ad03629e43ea, cookie 0x7645c8e1169f7fbb 00000100:00080000:3.0:1783950912.582691:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9e024793b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950912.582822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+5:2406:x1870607923806336:12345-192.168.202.33@tcp:250: Request processed in 1725us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.582835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 181 00000100:00100000:3.0:1783950912.587066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.587253:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923806464 00000100:00100000:1.0:1783950912.587343:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923806464 00000100:00100000:1.0:1783950912.587447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 182 00000100:00100000:1.0:1783950912.587463:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+5:6167:x1870607923806464:12345-192.168.202.33@tcp:101: 00010000:00010000:1.0:1783950912.587490:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950912.587516:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f419 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.587556:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.587589:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.587600:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67a00, rc 0) 00000100:00100000:1.0:1783950912.587685:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+6:6167:x1870607923806464:12345-192.168.202.33@tcp:101: Request processed in 226us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.587693:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 182 00000100:00100000:2.0:1783950912.590282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950912.590370:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923806592 00000100:00100000:3.0:1783950912.590379:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923806592 00000100:00100000:3.0:1783950912.590438:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 183 00000100:00100000:3.0:1783950912.590449:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+6:6167:x1870607923806592:12345-192.168.202.33@tcp:501: 00000100:00100000:3.0:1783950912.590581:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+6:6167:x1870607923806592:12345-192.168.202.33@tcp:501: Request processed in 134us (309us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783950912.590590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 183 00000100:00100000:2.0:1783950912.594768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950912.594880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923806720 00000100:00100000:3.0:1783950912.594893:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923806720 00000100:00100000:3.0:1783950912.594959:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 184 00000100:00100000:3.0:1783950912.594972:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+6:6167:x1870607923806720:12345-192.168.202.33@tcp:101: 00010000:00010000:3.0:1783950912.594991:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950912.595012:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f420 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950912.595078:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950912.595093:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950912.595103:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3200, rc 0) 00000100:00100000:3.0:1783950912.595862:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+7:6167:x1870607923806720:12345-192.168.202.33@tcp:101: Request processed in 888us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.595874:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 184 00000100:00100000:2.0:1783950912.601719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.601881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923806848 00000100:00100000:1.0:1783950912.601891:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923806848 00000100:00100000:1.0:1783950912.601944:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 185 00000100:00100000:1.0:1783950912.601953:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+7:6167:x1870607923806848:12345-192.168.202.33@tcp:501: 00000100:00100000:1.0:1783950912.602120:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6167:x1870607923806848:12345-192.168.202.33@tcp:501: Request processed in 167us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.602127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 185 00000100:00100000:2.0:1783950912.609055:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944828032:0@lo:41: 00000100:00100000:2.0:1783950912.609130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950912.609322:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783950912.609330:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944828160:0@lo:13: 00000100:00100000:2.0:1783950912.609358:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950912.609392:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828160 00000100:00100000:2.0:1783950912.609399:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828160 00000100:00100000:2.0:1783950912.609451:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783950912.609459:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944828160:12345-0@lo:13: 00002000:00000024:2.0:1783950912.609490:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950912.609533:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944828160:12345-0@lo:13: Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950912.609540:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783950912.609579:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4ca80 x1870607944828160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950912.609589:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783950912.609608:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944828160:0@lo:13: 00000100:00100000:0.0:1783950912.609786:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828032 00000100:00100000:0.0:1783950912.609790:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828032 00000100:00100000:0.0:1783950912.609833:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783950912.609842:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944828032:12345-0@lo:41: 00000004:00000024:0.0:1783950912.609866:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783950912.609906:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944828032:12345-0@lo:41: Request processed in 66us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950912.609912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783950912.609930:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950912.609939:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944828288:0@lo:13: 00000100:00100000:0.0:1783950912.609987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950912.610022:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828288 00000100:00100000:0.0:1783950912.610026:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828288 00000100:00100000:0.0:1783950912.610056:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783950912.610063:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944828288:12345-0@lo:13: 00002000:00000024:0.0:1783950912.610074:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950912.610103:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944828288:12345-0@lo:13: Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950912.610109:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783950912.610135:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469db800 x1870607944828288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950912.610177:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1783950912.610191:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944828288:0@lo:13: 00000100:00100000:0.0:1783950912.610238:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944828032:0@lo:41: 00000100:00080000:3.0:1783950912.610475:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783950912.610487:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944828544:0@lo:400: 00000100:00100000:3.0:1783950912.610519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950912.610539:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944829056:0@lo:400: 00000100:00100000:3.0:1783950912.610558:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950912.610574:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944829568:0@lo:400: 00000100:00100000:3.0:1783950912.610602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950912.610619:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783950912.610624:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944828672:0@lo:400: 00000100:00100000:3.0:1783950912.610645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950912.610655:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944829184:0@lo:400: 00000100:00100000:3.0:1783950912.610676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950912.610702:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828544 00000100:00100000:3.0:1783950912.610706:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828544 00000100:00100000:3.0:1783950912.610729:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829056 00000100:00100000:3.0:1783950912.610733:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829056 00000100:00100000:3.0:1783950912.610761:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829568 00000100:00100000:3.0:1783950912.610764:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829568 00000100:00100000:3.0:1783950912.610776:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828672 00000100:00100000:3.0:1783950912.610779:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828672 00000100:00100000:3.0:1783950912.610792:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783950912.610798:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944828544:12345-0@lo:400: 00000100:00100000:3.0:1783950912.610838:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944828544:12345-0@lo:400: Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.610845:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783950912.610857:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783950912.610864:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944829056:12345-0@lo:400: 00000100:00100000:3.0:1783950912.610890:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944829056:12345-0@lo:400: Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.610896:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783950912.610906:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783950912.610913:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944829568:12345-0@lo:400: 00000100:00100000:3.0:1783950912.610939:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944829568:12345-0@lo:400: Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.610944:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783950912.610954:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783950912.610960:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944828672:12345-0@lo:400: 00000100:00100000:3.0:1783950912.610986:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944828672:12345-0@lo:400: Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.610991:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783950912.611016:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829184 00000100:00100000:3.0:1783950912.611019:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829184 00000100:00100000:3.0:1783950912.611042:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783950912.611050:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944829184:12345-0@lo:400: 00000100:00100000:3.0:1783950912.611087:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944829184:12345-0@lo:400: Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.611093:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1783950912.611107:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783950912.611111:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783950912.611129:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b95180 x1870607944828672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950912.611162:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944828672:0@lo:400: 00010000:00080000:3.0:1783950912.611174:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b8b480 x1870607944829184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950912.611182:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944829184:0@lo:400: 00010000:00080000:3.0:1783950912.611191:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d246680 x1870607944828544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950912.611198:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944828544:0@lo:400: 00010000:00080000:3.0:1783950912.611223:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b89180 x1870607944829056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950912.611230:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944829056:0@lo:400: 00010000:00080000:3.0:1783950912.611238:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb4000 x1870607944829568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950912.611245:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944829568:0@lo:400: 00000100:00100000:0.0:1783950912.611649:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944828416:0@lo:400: 00000100:00100000:0.0:1783950912.611685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950912.611715:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944828928:0@lo:400: 00000100:00100000:0.0:1783950912.611738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950912.611765:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944829440:0@lo:400: 00000100:00100000:0.0:1783950912.611785:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950912.611804:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783950912.611810:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944828800:0@lo:400: 00000100:00100000:0.0:1783950912.611833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950912.611851:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944829312:0@lo:400: 00000100:00100000:0.0:1783950912.611870:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950912.611893:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828928 00000100:00100000:0.0:1783950912.611897:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828928 00000100:00100000:0.0:1783950912.611927:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829440 00000100:00100000:0.0:1783950912.611930:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829440 00000100:00100000:0.0:1783950912.611951:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783950912.611958:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944828928:12345-0@lo:400: 00000100:00100000:0.0:1783950912.611994:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944828928:12345-0@lo:400: Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950912.612000:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783950912.612013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783950912.612021:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944829440:12345-0@lo:400: 00000100:00100000:0.0:1783950912.612073:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944829440:12345-0@lo:400: Request processed in 54us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950912.612078:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783950912.612095:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950912.612105:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828800 00000100:00100000:0.0:1783950912.612108:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828800 00000100:00100000:0.0:1783950912.612132:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783950912.612138:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944828800:12345-0@lo:400: 00000100:00100000:0.0:1783950912.612194:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944828800:12345-0@lo:400: Request processed in 56us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950912.612199:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783950912.612243:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944828800:0@lo:400: 00010000:00080000:0.0:1783950912.612252:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b94700 x1870607944828928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950912.612260:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944828928:0@lo:400: 00010000:00080000:0.0:1783950912.612268:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb7100 x1870607944829440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950912.612275:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944829440:0@lo:400: 00010000:00010000:2.0:1783950912.612715:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950912.612913:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829312 00000100:00100000:3.0:1783950912.612919:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829312 00000100:00100000:3.0:1783950912.612971:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783950912.612979:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944829312:12345-0@lo:400: 00000100:00100000:2.0:1783950912.613349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.613415:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944828416 00000100:00100000:1.0:1783950912.613419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944828416 00000100:00100000:1.0:1783950912.613453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923806976 00000100:00100000:1.0:1783950912.613456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923806976 00000100:00100000:1.0:1783950912.613471:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783950912.613478:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944828416:12345-0@lo:400: 00000100:00100000:1.0:1783950912.613535:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944828416:12345-0@lo:400: Request processed in 57us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.613540:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783950912.613566:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 187 00000100:00100000:1.0:1783950912.613571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6167:x1870607923806976:12345-192.168.202.33@tcp:503: 00000100:00100000:1.0:1783950912.613693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6167:x1870607923806976:12345-192.168.202.33@tcp:503: Request processed in 120us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.613700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 187 00000100:00100000:1.0:1783950912.613738:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944828416:0@lo:400: 00000100:00100000:3.0:1783950912.614254:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944829312:12345-0@lo:400: Request processed in 1275us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.614261:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783950912.614353:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783950912.614418:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b8aa00 x1870607944829312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950912.614431:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944829312:0@lo:400: 00000100:00100000:3.0:1783950912.616593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.617196:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807104 00000100:00100000:1.0:1783950912.617221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807104 00000100:00100000:1.0:1783950912.617290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 188 00000100:00100000:1.0:1783950912.617301:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6185:x1870607923807104:12345-192.168.202.33@tcp:502: 00000100:00100000:1.0:1783950912.617486:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6185:x1870607923807104:12345-192.168.202.33@tcp:502: Request processed in 186us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.617495:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 188 00000100:00100000:1.0:1783950912.659543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950912.659646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807232 00000100:00100000:3.0:1783950912.659656:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807232 00000100:00100000:3.0:1783950912.659719:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 189 00000100:00100000:3.0:1783950912.659730:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6185:x1870607923807232:12345-192.168.202.33@tcp:502: 00000100:00100000:3.0:1783950912.659897:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6185:x1870607923807232:12345-192.168.202.33@tcp:502: Request processed in 168us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.659906:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 189 00000100:00100000:3.0:1783950912.661869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950912.661994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807360 00000100:00100000:0.0:1783950912.662010:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807360 00000100:00100000:0.0:1783950912.662435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 190 00000100:00100000:0.0:1783950912.662454:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6167:x1870607923807360:12345-192.168.202.33@tcp:101: 00010000:00010000:0.0:1783950912.662481:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950912.662572:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f7fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f451 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.662615:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f7fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f451 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.662640:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f7fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f451 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.662649:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67200, rc 0) 00000100:00100000:1.0:1783950912.662724:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6167:x1870607923807360:12345-192.168.202.33@tcp:101: Request processed in 277us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.662750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 190 00000100:00100000:2.0:1783950912.666736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.666862:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807488 00000100:00100000:1.0:1783950912.666875:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807488 00000100:00100000:1.0:1783950912.666950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 191 00000100:00100000:1.0:1783950912.666963:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6167:x1870607923807488:12345-192.168.202.33@tcp:256: 20000000:01000000:1.0:1783950912.666998:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783950912.667033:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783950912.667037:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783950912.667040:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783950912.667043:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783950912.667045:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1783950912.671780:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6167:x1870607923807488:12345-192.168.202.33@tcp:256: Request processed in 4804us (5043us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.671800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 191 00000100:00100000:2.0:1783950912.675296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.675422:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807616 00000100:00100000:1.0:1783950912.675436:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807616 00000100:00100000:1.0:1783950912.675515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 192 00000100:00100000:1.0:1783950912.675526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6167:x1870607923807616:12345-192.168.202.33@tcp:101: 00010000:00010000:1.0:1783950912.675550:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950912.675577:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f458 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.675615:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.675628:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950912.675667:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67000, rc 0) 00000100:00100000:1.0:1783950912.675826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6167:x1870607923807616:12345-192.168.202.33@tcp:101: Request processed in 301us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.675834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 192 00000100:00100000:2.0:1783950912.677577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.677783:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807744 00000100:00100000:1.0:1783950912.677793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807744 00000100:00100000:1.0:1783950912.677890:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 193 00000100:00100000:1.0:1783950912.677901:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6167:x1870607923807744:12345-192.168.202.33@tcp:501: 00000100:00100000:1.0:1783950912.678106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6167:x1870607923807744:12345-192.168.202.33@tcp:501: Request processed in 206us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.678115:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 193 00000100:00100000:2.0:1783950912.679683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.679768:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923807872 00000100:00100000:1.0:1783950912.679779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923807872 00000100:00100000:1.0:1783950912.679875:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 194 00000100:00100000:1.0:1783950912.679887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6167:x1870607923807872:12345-192.168.202.33@tcp:503: 00000100:00100000:1.0:1783950912.680075:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6167:x1870607923807872:12345-192.168.202.33@tcp:503: Request processed in 189us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.680084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 194 00000100:00100000:2.0:1783950912.682974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.683248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808000 00000100:00100000:1.0:1783950912.683270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808000 00000100:00100000:1.0:1783950912.683450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 195 00000100:00100000:1.0:1783950912.683462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6191:x1870607923808000:12345-192.168.202.33@tcp:502: 00000100:00100000:1.0:1783950912.683673:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6191:x1870607923808000:12345-192.168.202.33@tcp:502: Request processed in 213us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.683692:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 195 00000100:00100000:2.0:1783950912.688042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950912.688342:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808128 00000100:00100000:1.0:1783950912.688356:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808128 00000100:00100000:1.0:1783950912.688440:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 196 00000100:00100000:1.0:1783950912.688459:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6191:x1870607923808128:12345-192.168.202.33@tcp:502: 00000100:00100000:1.0:1783950912.688786:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6191:x1870607923808128:12345-192.168.202.33@tcp:502: Request processed in 329us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950912.688796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 196 00000100:00100000:2.0:1783950912.691720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950912.691805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950912.691936:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808256 00000100:00100000:0.0:1783950912.691965:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808256 00000100:00100000:0.0:1783950912.692069:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808512 00000100:00100000:0.0:1783950912.692073:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808512 00000100:00100000:3.0:1783950912.692110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783950912.692121:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870607923808256:12345-192.168.202.33@tcp:38: 00010000:00080000:3.0:1783950912.692198:0:6524:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1783950912.692293:0:6524:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f7fde 00000004:00100000:3.0:1783950912.692330:0:6524:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783950912.692632:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9e024793d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950912.692718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923808256:12345-192.168.202.33@tcp:38: Request processed in 596us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.692727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783950912.692749:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:3.0:1783950912.692753:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870607923808512:12345-192.168.202.33@tcp:38: 00010000:00080000:3.0:1783950912.692770:0:6524:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1783950912.692811:0:6524:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f7fe5 00000004:00100000:3.0:1783950912.692838:0:6524:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783950912.693025:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9e037e6da000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950912.693051:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923808512:12345-192.168.202.33@tcp:38: Request processed in 296us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950912.693059:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00010000:00010000:3.0:1783950913.632560:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950913.708320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950913.708373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950913.708414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950913.708424:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808768 00000100:00100000:3.0:1783950913.708439:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808768 00000100:00100000:3.0:1783950913.708523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808384 00000100:00100000:3.0:1783950913.708527:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808384 00000100:00100000:3.0:1783950913.708539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808640 00000100:00100000:3.0:1783950913.708542:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808640 00000100:00100000:3.0:1783950913.708606:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:3.0:1783950913.708619:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:6167:x1870607923808768:12345-192.168.202.33@tcp:41: 00000004:00000024:3.0:1783950913.708818:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783950913.709028:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:6167:x1870607923808768:12345-192.168.202.33@tcp:41: Request processed in 410us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950913.709044:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00080000:0.0:1783950913.709060:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950913.709066:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950913.709074:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:3.0:1783950913.709083:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923808384:12345-192.168.202.33@tcp:41: 00000004:00000024:3.0:1783950913.709096:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783950913.709118:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923808384:12345-192.168.202.33@tcp:41: Request processed in 37us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950913.709124:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:3.0:1783950913.709138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:3.0:1783950913.709191:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923808640:12345-192.168.202.33@tcp:41: 00000004:00000024:3.0:1783950913.709382:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950913.709423:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923808640:12345-192.168.202.33@tcp:41: Request processed in 235us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950913.709431:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1783950913.715993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950913.716426:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923808896 00000100:00100000:1.0:1783950913.716441:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923808896 00000100:00100000:1.0:1783950913.716577:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1783950913.716590:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6167:x1870607923808896:12345-192.168.202.33@tcp:40: 00000100:00100000:1.0:1783950913.716842:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6167:x1870607923808896:12345-192.168.202.33@tcp:40: Request processed in 253us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950913.716852:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1783950913.720955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950913.721080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950913.721626:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809024 00000100:00100000:3.0:1783950913.721641:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809024 00000100:00100000:3.0:1783950913.721718:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:3.0:1783950913.721730:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870607923809024:12345-192.168.202.33@tcp:8: 00010000:00080000:3.0:1783950913.721785:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:3.0:1783950913.721841:0:8441:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f7fec 00002000:00100000:3.0:1783950913.721860:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75392fba-af18-4ae6-9b8a-6f1db7dcbeed/ffff9e037e5db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783950913.722014:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783950913.722589:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783950913.723580:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e037e5df800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950913.723698:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923809024:12345-192.168.202.33@tcp:8: Request processed in 1963us (2754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950913.723711:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:0.0:1783950913.723876:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809280 00000100:00100000:0.0:1783950913.723885:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809280 00000100:00100000:0.0:1783950913.723969:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 197 00000100:00100000:0.0:1783950913.723980:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2410:x1870607923809280:12345-192.168.202.33@tcp:400: 00000100:00100000:0.0:1783950913.724023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2410:x1870607923809280:12345-192.168.202.33@tcp:400: Request processed in 47us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950913.724030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 197 00000100:00100000:0.0:1783950913.724175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950913.724368:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809152 00000100:00100000:0.0:1783950913.724372:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809152 00000100:00100000:0.0:1783950913.724398:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1783950913.724403:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870607923809152:12345-192.168.202.33@tcp:8: 00010000:00080000:0.0:1783950913.724435:0:9851:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1783950913.724475:0:9851:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f7ff3 00002000:00100000:0.0:1783950913.724492:0:9851:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75392fba-af18-4ae6-9b8a-6f1db7dcbeed/ffff9e037fc0d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783950913.724507:0:9851:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783950913.724714:0:9851:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783950913.724747:0:9851:0:(import.c:65:import_set_state_nolock()) ffff9e037fc0f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783950913.724788:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923809152:12345-192.168.202.33@tcp:8: Request processed in 383us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950913.724801:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1783950913.728557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950913.728760:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809408 00000100:00100000:2.0:1783950913.728773:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809408 00000100:00100000:2.0:1783950913.728852:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783950913.728865:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6167:x1870607923809408:12345-192.168.202.33@tcp:900: 00000100:00100000:2.0:1783950913.729120:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6167:x1870607923809408:12345-192.168.202.33@tcp:900: Request processed in 256us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950913.729129:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783950913.734417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950913.734762:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809536 00000100:00100000:3.0:1783950913.734776:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809536 00000100:00100000:3.0:1783950913.734855:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1783950913.735109:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6167:x1870607923809536:12345-192.168.202.33@tcp:33: 00000004:00080000:3.0:1783950913.770498:0:6528:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34660us 00000004:00200000:2.0:1783950913.800665:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783950913.800803:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6167:x1870607923809536:12345-192.168.202.33@tcp:33: Request processed in 65930us (66395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950913.800824:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:2.0:1783950914.066513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950914.066679:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809664 00000100:00100000:3.0:1783950914.066692:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809664 00000100:00100000:3.0:1783950914.066769:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1783950914.066781:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6209:x1870607923809664:12345-192.168.202.33@tcp:101: 00010000:00010000:3.0:1783950914.067047:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950914.067188:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3000/0x7645c8e1169f7ffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f489 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950914.067272:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950914.067286:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950914.067299:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783950914.067347:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783950914.067352:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783950914.067370:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950914.067396:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3000/0x7645c8e1169f7ffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f489 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950914.067414:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f489 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950914.067423:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109c800) 00010000:00010000:3.0:1783950914.067426:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783950914.067430:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3a00, rc 0) 00000100:00100000:3.0:1783950914.067491:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:6209:x1870607923809664:12345-192.168.202.33@tcp:101: Request processed in 712us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950914.067498:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00010000:00010000:0.0:1783950914.656617:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950914.656724:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944829696:0@lo:41: 00000100:00100000:2.0:1783950914.656794:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950914.657043:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829696 00000100:00100000:1.0:1783950914.657051:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829696 00000100:00100000:1.0:1783950914.657101:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783950914.657314:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944829696:12345-0@lo:41: 00000004:00000024:1.0:1783950914.657354:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783950914.657413:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944829696:12345-0@lo:41: Request processed in 302us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950914.657420:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783950914.657561:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944829696:0@lo:41: 00000100:00100000:2.0:1783950915.173115:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944829824:0@lo:13: 00000100:00100000:2.0:1783950915.173227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950915.173425:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829824 00000100:00100000:0.0:1783950915.173435:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829824 00000100:00100000:0.0:1783950915.173509:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783950915.173523:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944829824:12345-0@lo:13: 00002000:00000024:0.0:1783950915.173547:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950915.173593:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944829824:12345-0@lo:13: Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950915.173601:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1783950915.173661:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950915.173797:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbbe680 x1870607944829824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950915.173850:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944829824:0@lo:13: 00010000:00010000:2.0:1783950915.682652:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950915.682952:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944829952:0@lo:13: 00000100:00100000:1.0:1783950915.683021:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950915.683367:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944829952 00000100:00100000:0.0:1783950915.683376:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944829952 00000100:00100000:0.0:1783950915.683456:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783950915.683466:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944829952:12345-0@lo:13: 00002000:00000024:0.0:1783950915.683501:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950915.683552:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944829952:12345-0@lo:13: Request processed in 87us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950915.683560:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1783950915.683599:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb4000 x1870607944829952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950915.683618:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944829952:0@lo:13: 00000100:00080000:3.0:1783950915.683683:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783950916.302346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950916.302472:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809792 00000100:00100000:0.0:1783950916.302488:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809792 00000100:00100000:0.0:1783950916.302601:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:2.0:1783950916.302631:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783950916.302640:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:6261:x1870607923809792:12345-192.168.202.33@tcp:41: 00000100:00100000:2.0:1783950916.302664:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00000024:0.0:1783950916.302706:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783950916.302803:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:6261:x1870607923809792:12345-192.168.202.33@tcp:41: Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950916.302813:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00080000:3.0:1783950916.304220:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783950916.310455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950916.315698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923809920 00000100:00100000:3.0:1783950916.315720:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923809920 00000100:00100000:3.0:1783950916.315887:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:3.0:1783950916.315902:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6261:x1870607923809920:12345-192.168.202.33@tcp:41: 00000004:00000024:3.0:1783950916.315964:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950916.316091:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6261:x1870607923809920:12345-192.168.202.33@tcp:41: Request processed in 192us (6081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950916.316110:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1783950916.323552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950916.323867:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810048 00000100:00100000:1.0:1783950916.323881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810048 00000100:00080000:0.0:1783950916.323989:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783950916.323997:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783950916.327724:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:1.0:1783950916.327746:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6261:x1870607923810048:12345-192.168.202.33@tcp:13: 00002000:00000024:1.0:1783950916.327783:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783950916.327890:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6261:x1870607923810048:12345-192.168.202.33@tcp:13: Request processed in 152us (4357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950916.327898:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:1.0:1783950916.331838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950916.332001:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810176 00000100:00100000:0.0:1783950916.332015:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810176 00000100:00100000:0.0:1783950916.332222:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783950916.332247:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6261:x1870607923810176:12345-192.168.202.33@tcp:13: 00002000:00000024:0.0:1783950916.332296:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950916.332394:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:6261:x1870607923810176:12345-192.168.202.33@tcp:13: Request processed in 161us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950916.332404:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00080000:3.0:1783950916.333347:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783950916.705930:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950917.728549:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944830080:0@lo:41: 00000100:00100000:0.0:1783950917.728649:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950917.728728:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950917.728735:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944830208:0@lo:13: 00000100:00100000:0.0:1783950917.728762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950917.728810:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830080 00000100:00100000:0.0:1783950917.728820:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830080 00000100:00100000:0.0:1783950917.728881:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783950917.728892:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944830080:12345-0@lo:41: 00000004:00000024:0.0:1783950917.728941:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783950917.729001:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944830080:12345-0@lo:41: Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950917.729027:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783950917.729055:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830208 00000100:00100000:0.0:1783950917.729059:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830208 00000100:00100000:0.0:1783950917.729095:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783950917.729101:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944830208:12345-0@lo:13: 00002000:00000024:0.0:1783950917.729125:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950917.729481:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944830336:0@lo:400: 00000100:00100000:3.0:1783950917.729523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.729548:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944830848:0@lo:400: 00000100:00100000:3.0:1783950917.729572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.729590:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944831360:0@lo:400: 00000100:00100000:3.0:1783950917.729611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.729639:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783950917.729645:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944830464:0@lo:400: 00000100:00100000:3.0:1783950917.729669:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.729687:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944830976:0@lo:400: 00000100:00100000:3.0:1783950917.729709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.729727:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944831488:0@lo:400: 00000100:00100000:3.0:1783950917.729749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.729785:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830336 00000100:00100000:3.0:1783950917.729790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830336 00000100:00100000:3.0:1783950917.729828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783950917.729835:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944830336:12345-0@lo:400: 00000100:00100000:3.0:1783950917.729878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944830336:12345-0@lo:400: Request processed in 43us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.729885:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783950917.729920:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830848 00000100:00100000:3.0:1783950917.729924:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830848 00000100:00100000:3.0:1783950917.729948:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831360 00000100:00100000:3.0:1783950917.729951:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831360 00000100:00100000:3.0:1783950917.730013:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830464 00000100:00100000:3.0:1783950917.730016:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830464 00000100:00100000:3.0:1783950917.730029:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830976 00000100:00100000:3.0:1783950917.730031:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830976 00000100:00100000:3.0:1783950917.730044:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831488 00000100:00100000:3.0:1783950917.730047:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831488 00000100:00100000:3.0:1783950917.730061:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783950917.730067:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944830848:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730097:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944830848:12345-0@lo:400: Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730104:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783950917.730115:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950917.730121:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944831360:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730176:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944831360:12345-0@lo:400: Request processed in 55us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950917.730194:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783950917.730200:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944830464:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730233:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944830464:12345-0@lo:400: Request processed in 34us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730240:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783950917.730250:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783950917.730256:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944830976:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944830976:12345-0@lo:400: Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730286:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783950917.730297:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783950917.730303:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944831488:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730330:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944831488:12345-0@lo:400: Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730336:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783950917.730392:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944830464:0@lo:400: 00010000:00080000:3.0:1783950917.730409:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb5880 x1870607944830976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950917.730421:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944830976:0@lo:400: 00010000:00080000:3.0:1783950917.730432:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb7b80 x1870607944831488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950917.730441:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944831488:0@lo:400: 00000100:00100000:3.0:1783950917.730451:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944830336:0@lo:400: 00000100:00100000:3.0:1783950917.730461:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944830848:0@lo:400: 00000100:00100000:3.0:1783950917.730470:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944831360:0@lo:400: 00000100:00100000:3.0:1783950917.730520:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944830720:0@lo:400: 00000100:00100000:3.0:1783950917.730552:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.730574:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944831232:0@lo:400: 00000100:00100000:3.0:1783950917.730599:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.730620:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783950917.730626:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944830592:0@lo:400: 00000100:00100000:3.0:1783950917.730651:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.730668:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944831104:0@lo:400: 00000100:00100000:3.0:1783950917.730687:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.730705:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944831616:0@lo:400: 00000100:00100000:3.0:1783950917.730723:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.730751:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831232 00000100:00100000:3.0:1783950917.730755:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831232 00000100:00100000:3.0:1783950917.730782:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831104 00000100:00100000:3.0:1783950917.730784:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831104 00000100:00100000:3.0:1783950917.730796:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831616 00000100:00100000:3.0:1783950917.730798:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831616 00000100:00100000:3.0:1783950917.730810:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783950917.730815:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944831232:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730860:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944831232:12345-0@lo:400: Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730866:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783950917.730877:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783950917.730882:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944831104:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730904:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944831104:12345-0@lo:400: Request processed in 22us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730918:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783950917.730927:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783950917.730933:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944831616:12345-0@lo:400: 00000100:00100000:3.0:1783950917.730955:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944831616:12345-0@lo:400: Request processed in 22us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.730960:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783950917.730973:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830592 00000100:00100000:3.0:1783950917.730975:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830592 00000100:00100000:3.0:1783950917.730993:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783950917.731000:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944830592:12345-0@lo:400: 00000100:00100000:3.0:1783950917.731025:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944830592:12345-0@lo:400: Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.731031:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783950917.731069:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944830592:0@lo:400: 00010000:00080000:3.0:1783950917.731080:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb4e00 x1870607944831104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950917.731089:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944831104:0@lo:400: 00010000:00080000:3.0:1783950917.731097:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb7480 x1870607944831616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950917.731104:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944831616:0@lo:400: 00010000:00080000:3.0:1783950917.731112:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb5f80 x1870607944831232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950917.731120:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944831232:0@lo:400: 00000100:00100000:3.0:1783950917.731174:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944830720 00000100:00100000:3.0:1783950917.731184:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944830720 00000100:00100000:3.0:1783950917.731206:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783950917.731212:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944830720:12345-0@lo:400: 00000100:00100000:3.0:1783950917.731253:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944830720:12345-0@lo:400: Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.731259:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783950917.731282:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944830720:0@lo:400: 00000100:00080000:0.0:1783950917.733452:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783950917.733467:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950917.733471:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950917.733474:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783950917.733578:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944830080:0@lo:41: 00000100:00100000:0.0:1783950917.733744:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944830208:12345-0@lo:13: Request processed in 4640us (4978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950917.733757:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783950917.735132:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbbed80 x1870607944830208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950917.735187:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944830208:0@lo:13: 00000100:00100000:3.0:1783950917.736474:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944831744:0@lo:13: 00000100:00100000:3.0:1783950917.736564:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950917.737088:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831744 00000100:00100000:3.0:1783950917.737101:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831744 00000100:00100000:3.0:1783950917.737203:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783950917.737217:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944831744:12345-0@lo:13: 00002000:00000024:3.0:1783950917.737249:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950917.737304:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944831744:12345-0@lo:13: Request processed in 90us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950917.737312:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783950917.737358:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb5c00 x1870607944831744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950917.737378:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944831744:0@lo:13: 00010000:00010000:2.0:1783950917.739437:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783950918.244702:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000001:00100000:2.0:1783950918.245483:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000001:00100000:0.0:1783950918.245793:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00010000:00010000:3.0:1783950918.752670:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950918.922776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950918.922859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950918.922894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950918.922916:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950918.922939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950918.922969:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810816 00000100:00100000:2.0:1783950918.922978:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810816 00000100:00100000:2.0:1783950918.923039:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810688 00000100:00100000:2.0:1783950918.923043:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810688 00000100:00100000:2.0:1783950918.923068:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1783950918.923078:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923810816:12345-192.168.202.33@tcp:400: 00000100:00100000:2.0:1783950918.923181:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923810816:12345-192.168.202.33@tcp:400: Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950918.923190:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1783950918.923208:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783950918.923224:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923810688:12345-192.168.202.33@tcp:400: 00000100:00100000:2.0:1783950918.923252:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923810688:12345-192.168.202.33@tcp:400: Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950918.923258:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783950918.923276:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810560 00000100:00100000:2.0:1783950918.923280:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810560 00000100:00100000:2.0:1783950918.923310:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810432 00000100:00100000:2.0:1783950918.923313:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810432 00000100:00100000:2.0:1783950918.923334:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000001:02000400:3.0:1783950918.925048:0:10190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783950918.925223:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:1.0:1783950918.925243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923810432:12345-192.168.202.33@tcp:400: 00000100:00100000:1.0:1783950918.925311:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923810432:12345-192.168.202.33@tcp:400: Request processed in 76us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950918.925319:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:2.0:1783950918.928089:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923810560:12345-192.168.202.33@tcp:400: 00000100:00100000:2.0:1783950918.928212:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923810560:12345-192.168.202.33@tcp:400: Request processed in 4867us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950918.928224:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00080000:2.0:1783950918.928272:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783950918.928278:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783950918.928281:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783950918.928284:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783950918.930744:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810304 00000100:00100000:0.0:1783950918.930760:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810304 00000100:00100000:0.0:1783950918.930844:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 199 00000100:00100000:0.0:1783950918.930856:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923810304:12345-192.168.202.33@tcp:400: 00000100:00100000:0.0:1783950918.930942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923810304:12345-192.168.202.33@tcp:400: Request processed in 88us (8176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950918.930949:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 199 00000001:00100000:0.0:1783950919.270241:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00010000:00010000:3.0:1783950919.776665:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950919.778121:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950919.778172:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944831872:0@lo:41: 00000100:00100000:1.0:1783950919.778247:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950919.778639:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944831872 00000100:00100000:3.0:1783950919.778648:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944831872 00000100:00100000:3.0:1783950919.778713:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783950919.778738:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944831872:12345-0@lo:41: 00000004:00000024:3.0:1783950919.778782:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950919.778845:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944831872:12345-0@lo:41: Request processed in 108us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950919.778853:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783950919.785721:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944831872:0@lo:41: 00000100:00100000:3.0:1783950920.290865:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950920.290898:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944832000:0@lo:13: 00000100:00100000:3.0:1783950920.290963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950920.291026:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832000 00000100:00100000:3.0:1783950920.291033:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832000 00000100:00100000:3.0:1783950920.291083:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783950920.291095:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944832000:12345-0@lo:13: 00002000:00000024:3.0:1783950920.291125:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950920.291199:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944832000:12345-0@lo:13: Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950920.291207:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1783950920.291228:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950920.291262:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb5c00 x1870607944832000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950920.291282:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944832000:0@lo:13: 00010000:00010000:2.0:1783950920.800652:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950920.801053:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783950920.801078:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944832128:0@lo:13: 00000100:00100000:1.0:1783950920.801188:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950920.801574:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832128 00000100:00100000:3.0:1783950920.801582:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832128 00000100:00100000:3.0:1783950920.801644:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783950920.801651:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944832128:12345-0@lo:13: 00002000:00000024:3.0:1783950920.801671:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950920.801715:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944832128:12345-0@lo:13: Request processed in 65us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950920.801733:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783950920.801807:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783950920.801872:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbb5c00 x1870607944832128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950920.801896:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944832128:0@lo:13: 00010000:00010000:2.0:1783950921.825734:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.850670:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950922.850890:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944832640:0@lo:400: 00000100:00100000:1.0:1783950922.850968:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851022:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944833152:0@lo:400: 00000100:00100000:1.0:1783950922.851047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851071:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944833664:0@lo:400: 00000100:00100000:1.0:1783950922.851092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851131:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1783950922.851137:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944832256:0@lo:400: 00000100:00100000:1.0:1783950922.851203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851225:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944832768:0@lo:400: 00000100:00100000:1.0:1783950922.851248:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851265:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944833280:0@lo:400: 00000100:00100000:1.0:1783950922.851284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851298:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944833792:0@lo:400: 00000100:00100000:1.0:1783950922.851329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.851363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832640 00000100:00100000:1.0:1783950922.851371:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832640 00000100:00100000:1.0:1783950922.851421:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783950922.851429:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944832640:12345-0@lo:400: 00000100:00100000:1.0:1783950922.851483:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944832640:12345-0@lo:400: Request processed in 54us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.851490:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783950922.851515:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833152 00000100:00100000:1.0:1783950922.851518:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833152 00000100:00100000:1.0:1783950922.851545:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833664 00000100:00100000:1.0:1783950922.851548:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833664 00000100:00100000:1.0:1783950922.851561:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833280 00000100:00100000:1.0:1783950922.851564:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833280 00000100:00100000:1.0:1783950922.851587:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833792 00000100:00100000:1.0:1783950922.851591:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833792 00000100:00100000:1.0:1783950922.851605:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783950922.851610:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944833152:12345-0@lo:400: 00000100:00100000:1.0:1783950922.851644:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944833152:12345-0@lo:400: Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.851652:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783950922.851664:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783950922.851670:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944833664:12345-0@lo:400: 00000100:00100000:1.0:1783950922.851697:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944833664:12345-0@lo:400: Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.851703:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783950922.851714:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783950922.851721:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944833280:12345-0@lo:400: 00000100:00100000:1.0:1783950922.851745:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944833280:12345-0@lo:400: Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.851751:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783950922.851761:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783950922.851768:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944833792:12345-0@lo:400: 00000100:00100000:1.0:1783950922.851795:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944833792:12345-0@lo:400: Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.851802:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783950922.851825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832256 00000100:00100000:1.0:1783950922.851829:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832256 00000100:00100000:1.0:1783950922.851853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783950922.851859:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944832256:12345-0@lo:400: 00000100:00100000:1.0:1783950922.851902:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944832256:12345-0@lo:400: Request processed in 43us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.851913:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783950922.851943:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832768 00000100:00100000:1.0:1783950922.851947:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832768 00000100:00100000:1.0:1783950922.851971:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783950922.851976:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944832768:12345-0@lo:400: 00000100:00100000:1.0:1783950922.852009:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944832768:12345-0@lo:400: Request processed in 32us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.852015:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783950922.852039:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783950922.852043:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950922.852067:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944832256:0@lo:400: 00000100:00100000:1.0:1783950922.852078:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944832768:0@lo:400: 00010000:00080000:1.0:1783950922.852091:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e3b80 x1870607944833280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950922.852100:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944833280:0@lo:400: 00010000:00080000:1.0:1783950922.852109:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e0700 x1870607944833792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950922.852130:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944833792:0@lo:400: 00000100:00100000:1.0:1783950922.852164:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944832640:0@lo:400: 00010000:00080000:1.0:1783950922.852174:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e1500 x1870607944833152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950922.852182:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944833152:0@lo:400: 00010000:00080000:1.0:1783950922.852191:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e0000 x1870607944833664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950922.852206:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944833664:0@lo:400: 00000100:00100000:0.0:1783950922.852363:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944832512:0@lo:400: 00000100:00100000:0.0:1783950922.852396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852417:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944833024:0@lo:400: 00000100:00100000:0.0:1783950922.852448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852467:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944833536:0@lo:400: 00000100:00100000:0.0:1783950922.852491:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852512:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783950922.852518:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944832384:0@lo:400: 00000100:00100000:0.0:1783950922.852539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852557:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944832896:0@lo:400: 00000100:00100000:0.0:1783950922.852577:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852593:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944833408:0@lo:400: 00000100:00100000:0.0:1783950922.852613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852624:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944833920:0@lo:13: 00000100:00100000:0.0:1783950922.852661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.852697:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832512 00000100:00100000:0.0:1783950922.852701:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832512 00000100:00100000:0.0:1783950922.852725:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950922.852732:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944832512:12345-0@lo:400: 00000100:00100000:0.0:1783950922.852770:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944832512:12345-0@lo:400: Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.852777:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950922.852812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833024 00000100:00100000:0.0:1783950922.852815:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833024 00000100:00100000:0.0:1783950922.852839:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833536 00000100:00100000:0.0:1783950922.852842:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833536 00000100:00100000:0.0:1783950922.852856:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832384 00000100:00100000:0.0:1783950922.852859:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832384 00000100:00100000:0.0:1783950922.852869:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944832896 00000100:00100000:0.0:1783950922.852872:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944832896 00000100:00100000:0.0:1783950922.852883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833408 00000100:00100000:0.0:1783950922.852892:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833408 00000100:00100000:0.0:1783950922.852913:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783950922.852919:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944833024:12345-0@lo:400: 00000100:00100000:0.0:1783950922.852950:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944833024:12345-0@lo:400: Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.852956:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783950922.852968:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950922.852973:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944833536:12345-0@lo:400: 00000100:00100000:0.0:1783950922.852999:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944833536:12345-0@lo:400: Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.853005:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950922.853016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783950922.853022:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944832384:12345-0@lo:400: 00000100:00100000:0.0:1783950922.853049:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944832384:12345-0@lo:400: Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.853055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783950922.853066:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783950922.853072:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944832896:12345-0@lo:400: 00000100:00100000:0.0:1783950922.853096:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944832896:12345-0@lo:400: Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.853102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783950922.853125:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783950922.853132:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944833408:12345-0@lo:400: 00000100:00100000:0.0:1783950922.853184:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944833408:12345-0@lo:400: Request processed in 53us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.853190:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783950922.853221:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944833920 00000100:00100000:0.0:1783950922.853225:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944833920 00000100:00100000:0.0:1783950922.853249:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783950922.853255:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944833920:12345-0@lo:13: 00002000:00000024:0.0:1783950922.853285:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950922.853319:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944833920:12345-0@lo:13: Request processed in 64us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.853325:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783950922.853458:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950922.853462:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783950922.853494:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944832384:0@lo:400: 00000100:00100000:0.0:1783950922.853504:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944832896:0@lo:400: 00000100:00100000:0.0:1783950922.853513:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944833408:0@lo:400: 00010000:00080000:0.0:1783950922.853523:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbbca80 x1870607944833920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950922.853538:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944833920:0@lo:13: 00000100:00100000:0.0:1783950922.853547:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944832512:0@lo:400: 00010000:00080000:0.0:1783950922.853558:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e1f80 x1870607944833024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950922.853565:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944833024:0@lo:400: 00010000:00080000:0.0:1783950922.853576:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e3100 x1870607944833536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950922.853583:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944833536:0@lo:400: 00000100:00100000:3.0:1783950922.855543:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950922.855572:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944834048:0@lo:41: 00000100:00100000:3.0:1783950922.855640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.855785:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944834048 00000100:00100000:1.0:1783950922.855795:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944834048 00000100:00100000:1.0:1783950922.855838:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783950922.855846:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944834048:12345-0@lo:41: 00000004:00000024:1.0:1783950922.855880:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783950922.855935:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944834048:12345-0@lo:41: Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.855943:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783950922.856014:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944834048:0@lo:41: 00000100:00100000:1.0:1783950922.862031:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944834176:0@lo:13: 00000100:00100000:1.0:1783950922.862105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950922.862347:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944834176 00000100:00100000:0.0:1783950922.862363:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944834176 00000100:00100000:0.0:1783950922.862419:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783950922.862430:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944834176:12345-0@lo:13: 00002000:00000024:0.0:1783950922.862456:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950922.862506:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944834176:12345-0@lo:13: Request processed in 76us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.862513:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783950922.862551:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248012a00 x1870607944834176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950922.862571:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944834176:0@lo:13: 00000020:00000080:2.0:1783950922.917607:0:10338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5bb316a0 20000000:00000080:2.0:1783950922.917628:0:10338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e037fbae000 uarg=0000000000000000 20000000:01000000:2.0:1783950922.917687:0:10338:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783950922.917690:0:10338:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783950922.917694:0:10338:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783950922.917699:0:10338:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783950922.917705:0:10338:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783950922.917769:0:10338:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783950922.917772:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783950922.922454:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1783950922.922748:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1783950922.922783:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1783950922.922802:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1783950922.922815:0:10338:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783950922.922818:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783950922.923281:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1783950922.923435:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1783950922.923463:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1783950922.923481:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1783950922.923492:0:10338:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783950922.923494:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783950922.923846:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1783950922.924200:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1783950922.924232:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1783950922.924251:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1783950922.924261:0:10338:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783950922.924263:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783950922.925876:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1783950922.926519:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1783950922.926553:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1783950922.926570:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1783950922.926585:0:10338:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783950922.926587:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783950922.927006:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1783950922.927212:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1783950922.927238:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1783950922.927254:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1783950922.927268:0:10338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783950922.927289:0:10338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927307:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927315:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927335:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927342:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927348:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927356:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927364:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927372:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927378:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927388:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927396:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927404:0:10338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927457:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927473:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 9 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.927488:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834304:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783950922.927653:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927663:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.927673:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834432:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783950922.927707:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927716:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 23 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.927726:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834560:0@lo:104: 00000100:00100000:3.0:1783950922.927765:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950922.927802:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.927810:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 23 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.927830:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834688:0@lo:104: 00000100:00100000:3.0:1783950922.927853:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.927885:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944834560 00000100:00100000:3.0:1783950922.927892:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944834560 00000100:00100000:3.0:1783950922.927931:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944834688 00000100:00100000:3.0:1783950922.927935:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944834688 00000100:00100000:3.0:1783950922.927950:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783950922.927958:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:10338:x1870607944834560:12345-0@lo:104: 00010000:00010000:3.0:1783950922.927972:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928016:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783950922.928022:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+4:10338:x1870607944834560:12345-0@lo:104: Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.928030:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783950922.928048:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783950922.928054:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944834688:12345-0@lo:104: 00010000:00010000:3.0:1783950922.928061:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928090:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783950922.928095:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944834688:12345-0@lo:104: Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.928102:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783950922.928163:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928181:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 23 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.928190:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834816:0@lo:104: 00000100:00100000:3.0:1783950922.928213:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.928232:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944834816 00000100:00100000:3.0:1783950922.928235:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944834816 00000100:00100000:3.0:1783950922.928252:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783950922.928257:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944834816:12345-0@lo:104: 00010000:00010000:3.0:1783950922.928265:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928295:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783950922.928300:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944834816:12345-0@lo:104: Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.928306:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1783950922.928322:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783950922.928327:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928335:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950922.928339:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928347:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950922.928354:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950922.928366:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950922.928408:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928415:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950922.928437:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928445:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949000/0x7645c8e1169f7fad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7fb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928460:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783950922.928463:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928469:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950922.928472:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928479:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950922.928484:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950922.928489:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950922.928502:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928508:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950922.928528:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928535:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f7f83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928544:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783950922.928547:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928554:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950922.928556:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928563:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950922.928569:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950922.928574:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950922.928588:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928594:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950922.928598:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928605:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f7f67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f6e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928614:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.928622:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.928623:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950922.928637:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944834944:0@lo:103: 00000100:00100000:3.0:1783950922.928669:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.928705:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944835072:0@lo:103: 00000100:00100000:3.0:1783950922.928730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.928746:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950922.928751:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944835200:0@lo:103: 00000100:00100000:3.0:1783950922.928769:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.928794:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944834944 00000100:00100000:3.0:1783950922.928798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944834944 00010000:00010000:3.0:1783950922.928819:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.928833:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835072 00000100:00100000:3.0:1783950922.928836:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835072 00010000:00010000:3.0:1783950922.928845:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 25 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.928855:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835200 00000100:00100000:3.0:1783950922.928858:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835200 00010000:00010000:3.0:1783950922.928868:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 26 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.928878:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783950922.928885:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+26:3655:x1870607944834944:12345-0@lo:103: 00010000:00010000:3.0:1783950922.928895:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950922.928900:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 26 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928920:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 26 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.928938:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950922.928965:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+26:3655:x1870607944834944:12345-0@lo:103: Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.928971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783950922.929012:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783950922.929019:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+25:3652:x1870607944835072:12345-0@lo:103: 00010000:00010000:3.0:1783950922.929026:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950922.929030:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 25 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929037:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 25 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929046:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950922.929069:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+25:3652:x1870607944835072:12345-0@lo:103: Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.929074:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783950922.929086:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783950922.929092:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944835200:12345-0@lo:103: 00010000:00010000:3.0:1783950922.929098:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950922.929103:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929124:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929164:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950922.929189:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944835200:12345-0@lo:103: Request processed in 97us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.929196:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783950922.929234:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944834944:0@lo:103: 00000100:00100000:3.0:1783950922.929256:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944835200:0@lo:103: 00000100:00100000:3.0:1783950922.929262:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944835072:0@lo:103: 00010000:00010000:3.0:1783950922.929295:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929305:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 23 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.929315:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835328:0@lo:104: 00000100:00100000:3.0:1783950922.929341:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.929369:0:7466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783950922.929378:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835328 00000100:00100000:3.0:1783950922.929381:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835328 00000100:00100000:3.0:1783950922.929400:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783950922.929407:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944835328:12345-0@lo:104: 00010000:00010000:3.0:1783950922.929416:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929449:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783950922.929454:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944835328:12345-0@lo:104: Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.929469:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1783950922.929506:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783950922.929511:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929519:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950922.929522:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929529:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950922.929537:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950922.929543:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950922.929558:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929564:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950922.929576:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929583:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145e00/0x7645c8e1169f7f3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929598:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.929599:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.929601:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950922.929606:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783950922.929621:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944835456:0@lo:103: 00000100:00100000:3.0:1783950922.929644:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.929667:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835456 00000100:00100000:3.0:1783950922.929671:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835456 00010000:00010000:3.0:1783950922.929686:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 24 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.929702:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783950922.929708:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944835456:12345-0@lo:103: 00010000:00010000:3.0:1783950922.929716:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950922.929720:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 24 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929727:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 24 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929737:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950922.929762:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944835456:12345-0@lo:103: Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.929768:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783950922.929792:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944835456:0@lo:103: 00010000:00010000:3.0:1783950922.929820:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929828:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 23 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.929837:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835584:0@lo:104: 00000100:00100000:3.0:1783950922.929859:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.929886:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835584 00000100:00100000:3.0:1783950922.929890:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835584 00000100:00100000:3.0:1783950922.929907:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783950922.929913:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944835584:12345-0@lo:104: 00010000:00010000:3.0:1783950922.929921:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929951:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783950922.929956:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944835584:12345-0@lo:104: Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.929962:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1783950922.929976:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783950922.929980:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929986:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783950922.929990:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.929997:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783950922.930002:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950922.930008:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783950922.930022:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.930027:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783950922.930042:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.930048:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f7f21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.930056:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.930058:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950922.930059:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950922.930069:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944835712:0@lo:103: 00000100:00100000:3.0:1783950922.930092:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950922.931200:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950922.931210:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950922.931224:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835712 00000100:00100000:2.0:1783950922.931231:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835712 00010000:00010000:2.0:1783950922.931266:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950922.931298:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783950922.931306:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944835712:12345-0@lo:103: 00010000:00010000:2.0:1783950922.931319:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950922.931324:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.931333:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.931351:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783950922.935037:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.935058:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 24 pid: 6517 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935075:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835840:0@lo:104: 00000100:00100000:3.0:1783950922.935172:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950922.935204:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.935214:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935223:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835968:0@lo:104: 00000100:00100000:3.0:1783950922.935268:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950922.935293:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.935313:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935322:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944836096:0@lo:104: 00000100:00100000:3.0:1783950922.935344:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950922.935375:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.935384:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 24 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935392:0:10338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944836224:0@lo:104: 00000100:00100000:3.0:1783950922.935411:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950922.935422:0:10338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e4133c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783950922.935448:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340031800/0x7645c8e1169f7fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7fad expref: 24 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935465:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834560:0@lo:104: 00010000:00010000:3.0:1783950922.935476:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030800/0x7645c8e1169f7f8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7f83 expref: 23 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935485:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834688:0@lo:104: 00010000:00010000:3.0:1783950922.935495:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66800/0x7645c8e1169f7f6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7f67 expref: 22 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935502:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834816:0@lo:104: 00010000:00010000:3.0:1783950922.935511:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f7f44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7f3d expref: 21 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935528:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835328:0@lo:104: 00010000:00010000:3.0:1783950922.935542:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030400/0x7645c8e1169f7f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7f21 expref: 20 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.935551:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835584:0@lo:104: 00000100:00100000:1.0:1783950922.935646:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835840 00000100:00100000:1.0:1783950922.935652:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835840 00000100:00100000:1.0:1783950922.935689:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944835968 00000100:00100000:1.0:1783950922.935691:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944835968 00000100:00100000:1.0:1783950922.935700:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836096 00000100:00100000:1.0:1783950922.935703:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836096 00000100:00100000:1.0:1783950922.935710:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836224 00000100:00100000:1.0:1783950922.935713:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836224 00000100:00100000:1.0:1783950922.935723:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783950922.935731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+6:10338:x1870607944835840:12345-0@lo:104: 00010000:00010000:1.0:1783950922.935746:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.935834:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783950922.935841:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+6:10338:x1870607944835840:12345-0@lo:104: Request processed in 110us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.935849:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783950922.935866:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783950922.935872:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+5:10338:x1870607944835968:12345-0@lo:104: 00010000:00010000:1.0:1783950922.935880:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.935913:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783950922.935918:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+5:10338:x1870607944835968:12345-0@lo:104: Request processed in 47us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.935924:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783950922.935936:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783950922.935942:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:10338:x1870607944836096:12345-0@lo:104: 00010000:00010000:1.0:1783950922.935950:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.935981:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783950922.935986:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+4:10338:x1870607944836096:12345-0@lo:104: Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.935991:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783950922.936003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783950922.936008:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944836224:12345-0@lo:104: 00010000:00010000:1.0:1783950922.936015:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936049:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783950922.936054:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+3:10338:x1870607944836224:12345-0@lo:104: Request processed in 46us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950922.936060:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1783950922.936077:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783950922.936083:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936091:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950922.936096:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936105:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950922.936123:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950922.936129:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950922.936184:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936192:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950922.936210:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936216:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c2000/0x7645c8e1169f7f13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f1a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936236:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783950922.936239:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936244:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950922.936247:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936253:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950922.936259:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950922.936264:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950922.936278:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936284:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950922.936290:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936296:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f7f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7f0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936306:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783950922.936308:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936323:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950922.936326:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936332:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950922.936338:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950922.936343:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783950922.936356:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.936361:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783950922.936437:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835840:0@lo:104: 00000100:00100000:3.0:1783950922.936445:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944835968:0@lo:104: 00000100:00100000:3.0:1783950922.936451:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944836096:0@lo:104: 00000100:00100000:3.0:1783950922.936457:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944836224:0@lo:104: 00000100:00100000:2.0:1783950922.937992:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+19:3655:x1870607944835712:12345-0@lo:103: Request processed in 6676us (7889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950922.938007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1783950922.938059:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783950922.938080:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.938090:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783950922.938095:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.938105:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950922.938125:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950922.938132:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783950922.938182:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.938190:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783950922.938329:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944836736:0@lo:103: 00000100:00100000:3.0:1783950922.938388:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950922.938489:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.938500:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340031600/0x7645c8e1169f7ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ecd expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950922.938513:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950922.938516:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950922.938518:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950922.938531:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944836352:0@lo:103: 00000100:00100000:1.0:1783950922.938560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.938587:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950922.938594:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944836480:0@lo:103: 00000100:00100000:1.0:1783950922.938628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950922.938654:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944836608:0@lo:103: 00000100:00100000:1.0:1783950922.938679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950922.942957:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.942975:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145000/0x7645c8e1169f7e9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ea3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.942999:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950922.943002:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950922.943004:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950922.943027:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836736 00000100:00100000:2.0:1783950922.943036:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836736 00010000:00010000:2.0:1783950922.943099:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 19 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950922.943162:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836352 00000100:00100000:2.0:1783950922.943166:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836352 00010000:00010000:2.0:1783950922.943181:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 20 pid: 6517 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950922.943192:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836480 00000100:00100000:2.0:1783950922.943195:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836480 00010000:00010000:2.0:1783950922.943206:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 21 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950922.943216:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836608 00000100:00100000:2.0:1783950922.943219:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836608 00010000:00010000:2.0:1783950922.943229:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 22 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950922.943242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783950922.943249:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+22:3655:x1870607944836736:12345-0@lo:103: 00010000:00010000:2.0:1783950922.943265:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950922.943270:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 22 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943280:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 22 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943298:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340031c00/0x7645c8e1169f7ea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7e9c expref: 22 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943313:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950922.943386:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+21:3655:x1870607944836736:12345-0@lo:103: Request processed in 136us (4997us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950922.943403:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783950922.943420:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783950922.943425:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+20:3652:x1870607944836352:12345-0@lo:103: 00010000:00010000:2.0:1783950922.943433:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950922.943438:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 20 pid: 6517 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943445:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 20 pid: 6517 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943455:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f7f1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7f13 expref: 20 pid: 6517 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943465:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950922.943495:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+19:3652:x1870607944836352:12345-0@lo:103: Request processed in 70us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950922.943501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783950922.943514:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783950922.943519:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+18:3652:x1870607944836480:12345-0@lo:103: 00010000:00010000:2.0:1783950922.943526:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950922.943530:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 18 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943538:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 18 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943547:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3800/0x7645c8e1169f7f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7f05 expref: 18 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943564:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950922.943586:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+17:3652:x1870607944836480:12345-0@lo:103: Request processed in 67us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950922.943592:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783950922.943628:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783950922.943634:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+16:3654:x1870607944836608:12345-0@lo:103: 00010000:00010000:2.0:1783950922.943642:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950922.943646:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 16 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943654:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 16 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943664:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f7ecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7ec6 expref: 16 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.943672:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950922.943693:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+15:3654:x1870607944836608:12345-0@lo:103: Request processed in 59us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950922.943699:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1783950922.943724:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950922.943758:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944836480:0@lo:103: 00000100:00100000:2.0:1783950922.943768:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944836352:0@lo:103: 00000100:00100000:0.0:1783950922.943921:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944836608:0@lo:103: 00000100:00100000:3.0:1783950922.944254:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944835712:0@lo:103: 00000100:00100000:3.0:1783950922.944279:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944836736:0@lo:103: 00000100:00100000:2.0:1783950922.944570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950922.944639:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923810944 00000100:00100000:0.0:1783950922.944645:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923810944 00010000:00010000:0.0:1783950922.944672:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 10 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950922.944701:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:0.0:1783950922.944708:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923810944:12345-192.168.202.33@tcp:103: 00010000:00010000:0.0:1783950922.944720:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783950922.944725:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 10 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950922.944736:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 10 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950922.944750:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783950922.944804:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923810944:12345-192.168.202.33@tcp:103: Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950922.944823:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00010000:00010000:3.0:1783950922.945043:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f7fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f420 expref: 9 pid: 6519 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.945055:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834304:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783950922.945065:0:10338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1870607944834432:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783950922.945118:0:10338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950922.950584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950922.950663:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811072 00000100:00100000:3.0:1783950922.950673:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811072 00010000:00010000:3.0:1783950922.950729:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950922.950772:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:3.0:1783950922.950782:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:2407:x1870607923811072:12345-192.168.202.33@tcp:103: 00010000:00010000:3.0:1783950922.950797:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950922.950803:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950816:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950834:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67a00/0x7645c8e1169f7fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f419 expref: 9 pid: 6520 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950850:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950859:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950877:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950884:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950891:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950898:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950911:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783950922.950915:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950924:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950938:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950922.950950:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950922.951002:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:2407:x1870607923811072:12345-192.168.202.33@tcp:103: Request processed in 221us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950922.951009:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00010000:00010000:2.0:1783950922.951256:0:10338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.951276:0:10338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950922.951282:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8008 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950923.872311:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950924.035717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950924.035925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950924.035974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950924.036005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950924.036072:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811584 00000100:00100000:1.0:1783950924.036081:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811584 00000100:00100000:1.0:1783950924.036179:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:1.0:1783950924.036188:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923811584:12345-192.168.202.33@tcp:400: 00000100:00100000:1.0:1783950924.036271:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923811584:12345-192.168.202.33@tcp:400: Request processed in 84us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950924.036280:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00080000:1.0:1783950924.036319:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950924.036977:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811200 00000100:00100000:3.0:1783950924.036985:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811200 00000100:00100000:3.0:1783950924.037041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 201 00000100:00100000:3.0:1783950924.037050:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:2407:x1870607923811200:12345-192.168.202.33@tcp:400: 00000100:00100000:3.0:1783950924.037122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:2407:x1870607923811200:12345-192.168.202.33@tcp:400: Request processed in 73us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.037129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 201 00000100:00100000:0.0:1783950924.039041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950924.039249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811712 00000100:00100000:3.0:1783950924.039257:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811712 00000100:00100000:3.0:1783950924.039318:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:3.0:1783950924.039331:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923811712:12345-192.168.202.33@tcp:400: 00000100:00100000:3.0:1783950924.039392:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923811712:12345-192.168.202.33@tcp:400: Request processed in 66us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.039411:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00080000:0.0:1783950924.039623:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783950924.039940:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811328 00000100:00100000:2.0:1783950924.039946:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811328 00000100:00080000:0.0:1783950924.040473:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950924.040607:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811456 00000100:00100000:0.0:1783950924.040612:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811456 00000100:00100000:0.0:1783950924.040661:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:0.0:1783950924.040670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923811328:12345-192.168.202.33@tcp:400: 00000100:00100000:0.0:1783950924.040723:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923811328:12345-192.168.202.33@tcp:400: Request processed in 55us (5016us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.040730:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:0.0:1783950924.040745:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:0.0:1783950924.040751:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923811456:12345-192.168.202.33@tcp:400: 00000100:00100000:0.0:1783950924.040774:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923811456:12345-192.168.202.33@tcp:400: Request processed in 24us (4769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.040794:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00080000:3.0:1783950924.041410:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 10000000:01000000:1.0:1783950924.704348:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783950924.704357:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0241aa4000 from 48 10000000:01000000:1.0:1783950924.704363:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783950924.704416:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.704428:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.704440:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.704480:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944836864:0@lo:101: 00000100:00100000:1.0:1783950924.706326:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.706393:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c240 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.706500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836864 00000100:00100000:0.0:1783950924.706514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836864 00000100:00100000:0.0:1783950924.706557:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783950924.706565:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+15:6522:x1870607944836864:12345-0@lo:101: 00010000:00010000:0.0:1783950924.706581:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950924.706610:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f8016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f800f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.706634:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f8016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f800f expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.706641:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f8016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f800f expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.706648:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d800, rc 0) 00000100:00100000:0.0:1783950924.706686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944836864:12345-0@lo:101: Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.706691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1783950924.707107:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944836864:0@lo:101: 00010000:00010000:1.0:1783950924.707133:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.707163:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.707242:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944836992:0@lo:501: 00000100:00100000:1.0:1783950924.707336:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.707406:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.709460:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944836992 00000100:00100000:3.0:1783950924.709512:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944836992 00000100:00100000:3.0:1783950924.709585:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783950924.709596:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944836992:12345-0@lo:501: 00000100:00100000:3.0:1783950924.709772:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944836992:12345-0@lo:501: Request processed in 177us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.709779:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783950924.709831:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944836992:0@lo:501: 00000100:00100000:1.0:1783950924.709875:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837120:0@lo:503: 00000100:00100000:1.0:1783950924.709926:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.711646:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.711683:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837120 00000100:00100000:3.0:1783950924.711692:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837120 00000100:00100000:3.0:1783950924.713300:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783950924.713324:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944837120:12345-0@lo:503: 00000100:00100000:3.0:1783950924.714088:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944837120:12345-0@lo:503: Request processed in 773us (4159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.714109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783950924.714196:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837120:0@lo:503: 00000100:00100000:1.0:1783950924.714718:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10355:1870607944837248:0@lo:502: 00000100:00100000:1.0:1783950924.714761:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.714798:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.715270:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837248 00000100:00100000:2.0:1783950924.715277:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837248 00000100:00100000:2.0:1783950924.715322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783950924.715331:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:10355:x1870607944837248:12345-0@lo:502: 00000100:00100000:2.0:1783950924.715606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+16:10355:x1870607944837248:12345-0@lo:502: Request processed in 275us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950924.715614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783950924.715623:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10355:1870607944837248:0@lo:502: 00000100:00100000:1.0:1783950924.715665:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10355:1870607944837376:0@lo:502: 00000100:00100000:1.0:1783950924.715694:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.715718:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.715740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837376 00000100:00100000:3.0:1783950924.715745:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837376 00000100:00100000:3.0:1783950924.715780:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783950924.715800:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:10355:x1870607944837376:12345-0@lo:502: 00000100:00100000:3.0:1783950924.716306:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+16:10355:x1870607944837376:12345-0@lo:502: Request processed in 519us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.716314:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783950924.716367:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10355:1870607944837376:0@lo:502: 00000040:00080000:1.0:1783950924.716395:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783950924.716527:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783950924.716546:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783950924.716557:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.716569:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950924.716578:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783950924.716581:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1783950924.716584:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783950924.716609:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.716630:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.716638:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950924.716653:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837504:0@lo:101: 00000100:00100000:2.0:1783950924.716680:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.716710:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.716768:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837504 00000100:00100000:3.0:1783950924.716773:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837504 00000100:00100000:0.0:1783950924.716901:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783950924.716912:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+16:6522:x1870607944837504:12345-0@lo:101: 00010000:00010000:0.0:1783950924.716922:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950924.716935:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f8024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f801d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.716956:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f8024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f801d expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.716967:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f8024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f801d expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.716975:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5ca00, rc 0) 00000100:00100000:0.0:1783950924.717013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944837504:12345-0@lo:101: Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.717019:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783950924.717090:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837504:0@lo:101: 00010000:00010000:2.0:1783950924.717116:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.717124:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950924.717515:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837632:0@lo:501: 00000100:00100000:2.0:1783950924.717548:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.717577:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.717625:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837632 00000100:00100000:3.0:1783950924.717630:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837632 00000100:00100000:3.0:1783950924.717674:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783950924.717681:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944837632:12345-0@lo:501: 00000100:00100000:3.0:1783950924.717965:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944837632:12345-0@lo:501: Request processed in 284us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.717972:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1783950924.718288:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837632:0@lo:501: 00000100:00100000:2.0:1783950924.718323:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837760:0@lo:503: 00000100:00100000:2.0:1783950924.718366:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.718443:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.718537:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837760 00000100:00100000:3.0:1783950924.718543:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837760 00000100:00100000:3.0:1783950924.718579:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783950924.718586:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944837760:12345-0@lo:503: 00000100:00100000:3.0:1783950924.718717:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944837760:12345-0@lo:503: Request processed in 131us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.718724:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783950924.718789:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944837760:0@lo:503: 00000100:00100000:2.0:1783950924.719674:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10356:1870607944837888:0@lo:502: 00000100:00100000:2.0:1783950924.719727:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.719838:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.720602:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944837888 00000100:00100000:3.0:1783950924.720615:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944837888 00000100:00100000:3.0:1783950924.720657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783950924.720666:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:10356:x1870607944837888:12345-0@lo:502: 00000100:00100000:3.0:1783950924.721361:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+17:10356:x1870607944837888:12345-0@lo:502: Request processed in 692us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.721372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783950924.721526:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10356:1870607944837888:0@lo:502: 00000020:01000000:2.0:1783950924.721565:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950924.721575:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950924.721577:0:10356:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783950924.721582:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783950924.721613:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10356:1870607944838016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950924.721658:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.721731:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.721770:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838016 00000100:00100000:3.0:1783950924.721775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838016 00000100:00100000:3.0:1783950924.722117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783950924.722128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:10356:x1870607944838016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.725765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:10356:x1870607944838016:12345-0@lo:502:llog_process_th.0 Request processed in 3627us (4095us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.725779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1783950924.725799:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10356:1870607944838016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783950924.725849:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783950924.725856:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950924.725858:0:10356:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783950924.725862:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1783950924.725929:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783950924.725950:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783950924.725960:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.725971:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950924.725982:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783950924.725984:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377952800 from 48 10000000:01000000:1.0:1783950924.725987:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783950924.726030:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.726039:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.726048:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.726068:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.726114:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.726164:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.726585:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838144 00000100:00100000:3.0:1783950924.726600:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838144 00000100:00100000:3.0:1783950924.726635:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783950924.726644:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+17:6522:x1870607944838144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.726656:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950924.726670:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f8032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f802b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.726693:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f8032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f802b expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.726703:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f8032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f802b expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.726712:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3200, rc 0) 00000100:00100000:3.0:1783950924.726761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944838144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.726767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783950924.727042:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783950924.727057:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.727078:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.727173:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.727201:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.727221:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.727365:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838272 00000100:00100000:3.0:1783950924.727370:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838272 00000100:00100000:3.0:1783950924.727402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783950924.727408:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944838272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.727714:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944838272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.727722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783950924.731374:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.731452:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.731556:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.731614:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.732025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838400 00000100:00100000:3.0:1783950924.732033:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838400 00000100:00100000:3.0:1783950924.732105:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1783950924.732117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944838400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.732279:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944838400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.732287:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783950924.733226:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950924.733978:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10357:1870607944838528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950924.734064:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.734113:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.734232:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838528 00000100:00100000:0.0:1783950924.734239:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838528 00000100:00100000:0.0:1783950924.734287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783950924.734294:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:10357:x1870607944838528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950924.734418:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+18:10357:x1870607944838528:12345-0@lo:502:llog_process_th.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.734425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783950924.734876:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10357:1870607944838528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950924.734920:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10357:1870607944838656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950924.734950:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950924.734978:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.735030:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838656 00000100:00100000:3.0:1783950924.735035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838656 00000100:00100000:3.0:1783950924.735070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783950924.735077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:10357:x1870607944838656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.735188:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+18:10357:x1870607944838656:12345-0@lo:502:llog_process_th.0 Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.735194:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783950924.735358:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10357:1870607944838656:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783950924.735374:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783950924.735888:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783950924.735913:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783950924.735925:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.735936:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950924.735946:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783950924.735948:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1783950924.735951:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783950924.735976:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.735985:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.735994:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.736029:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.736063:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.736103:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.736227:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838784 00000100:00100000:2.0:1783950924.736233:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838784 00000100:00100000:2.0:1783950924.736278:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783950924.736285:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+18:6522:x1870607944838784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783950924.736294:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950924.736307:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949800/0x7645c8e1169f8040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8039 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.736336:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949800/0x7645c8e1169f8040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8039 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.736346:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949800/0x7645c8e1169f8040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8039 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950924.736354:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949800, rc 0) 00000100:00100000:2.0:1783950924.736388:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944838784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950924.736393:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783950924.736905:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.736919:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.736927:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.736978:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.737004:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.737124:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5000 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.766896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944838912 00000100:00100000:0.0:1783950924.766910:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944838912 00000100:00100000:0.0:1783950924.766988:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783950924.766999:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944838912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.767231:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944838912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (30224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.767239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783950924.768080:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944838912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.768185:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.768247:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.768290:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.768309:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839040 00000100:00100000:3.0:1783950924.768314:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839040 00000100:00100000:3.0:1783950924.768349:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783950924.768357:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944839040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.768455:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944839040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.768462:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783950924.768521:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.768750:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10358:1870607944839168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.768786:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.768805:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839168 00000100:00100000:3.0:1783950924.768808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839168 00000100:00100000:3.0:1783950924.768825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783950924.768831:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:10358:x1870607944839168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.768900:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:10358:x1870607944839168:12345-0@lo:502:llog_process_th.0 Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.768907:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783950924.768934:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.768946:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10358:1870607944839168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783950924.768966:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783950924.768974:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950924.768977:0:10358:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783950924.768982:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783950924.769001:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10358:1870607944839296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.769032:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.769050:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839296 00000100:00100000:3.0:1783950924.769053:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839296 00000100:00100000:3.0:1783950924.769071:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783950924.769078:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:10358:x1870607944839296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.769170:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:10358:x1870607944839296:12345-0@lo:502:llog_process_th.0 Request processed in 92us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.769177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783950924.769204:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.769221:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10358:1870607944839296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783950924.769237:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950924.769241:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950924.769242:0:10358:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783950924.769246:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1783950924.769302:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783950924.769321:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783950924.769331:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769342:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950924.769353:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783950924.769356:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377b14000 from 48 10000000:01000000:3.0:1783950924.769359:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783950924.769381:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769388:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769398:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.769411:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.769435:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.769449:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.769461:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839424 00000100:00100000:3.0:1783950924.769464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839424 00000100:00100000:3.0:1783950924.769488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783950924.769494:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+19:6522:x1870607944839424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.769503:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950924.769515:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f804e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8047 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769536:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f804e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8047 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769546:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f804e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8047 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769554:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2200, rc 0) 00000100:00100000:3.0:1783950924.769589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944839424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.769595:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783950924.769625:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.769638:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.769647:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.769690:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.769712:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.769724:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.769734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839552 00000100:00100000:3.0:1783950924.769737:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839552 00000100:00100000:3.0:1783950924.769762:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783950924.769768:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944839552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.769857:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944839552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.769864:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783950924.769892:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.769915:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.769947:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.769960:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.769970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839680 00000100:00100000:3.0:1783950924.769973:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839680 00000100:00100000:3.0:1783950924.769990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783950924.769995:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944839680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.770058:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944839680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.770064:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783950924.770110:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944839680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.770357:0:10359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10359:1870607944839808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.770388:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.770404:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839808 00000100:00100000:3.0:1783950924.770408:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839808 00000100:00100000:3.0:1783950924.770424:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783950924.770430:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:10359:x1870607944839808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.770493:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:10359:x1870607944839808:12345-0@lo:502:llog_process_th.0 Request processed in 63us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.770504:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783950924.770532:0:10359:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.770543:0:10359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10359:1870607944839808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.770576:0:10359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10359:1870607944839936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.770604:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.770618:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944839936 00000100:00100000:3.0:1783950924.770622:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944839936 00000100:00100000:3.0:1783950924.770637:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783950924.770642:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:10359:x1870607944839936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.770692:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:10359:x1870607944839936:12345-0@lo:502:llog_process_th.0 Request processed in 49us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.770697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783950924.770720:0:10359:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.770729:0:10359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10359:1870607944839936:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783950924.770743:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783950924.770779:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783950924.770793:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783950924.770801:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.770810:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950924.770818:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783950924.770820:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1783950924.770823:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783950924.770846:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.770854:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.770861:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.770871:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.770896:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.770909:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.770920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840064 00000100:00100000:3.0:1783950924.770923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840064 00000100:00100000:3.0:1783950924.770942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783950924.770947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944840064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.770953:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950924.770963:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f805c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8055 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.770978:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f805c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8055 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.770987:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f805c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8055 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.770995:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3400, rc 0) 00000100:00100000:3.0:1783950924.771022:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944840064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.771027:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783950924.771060:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.771071:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.771079:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.781462:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.781552:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.781601:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c000 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.781678:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840192 00000100:00100000:2.0:1783950924.781685:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840192 00000100:00100000:2.0:1783950924.781741:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783950924.781750:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944840192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950924.781891:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944840192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950924.781899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783950924.782405:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.782458:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.782530:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.782544:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c000 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.782654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840320 00000100:00100000:0.0:1783950924.782659:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840320 00000100:00100000:0.0:1783950924.782741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783950924.782751:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944840320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.782876:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944840320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.782882:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783950924.783478:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.783711:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10360:1870607944840448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.783766:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.784461:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c000 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.784639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840448 00000100:00100000:2.0:1783950924.784645:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840448 00000100:00100000:3.0:1783950924.784731:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783950924.784738:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:10360:x1870607944840448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.784893:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:10360:x1870607944840448:12345-0@lo:502:llog_process_th.0 Request processed in 154us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.784900:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783950924.785082:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10360:1870607944840448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783950924.785410:0:10360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783950924.785422:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950924.785434:0:10360:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783950924.785442:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783950924.785610:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10360:1870607944840576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.785655:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.785926:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88780 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.785960:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840576 00000100:00100000:0.0:1783950924.785966:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840576 00000100:00100000:0.0:1783950924.786125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1783950924.786134:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:10360:x1870607944840576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.786377:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10360:1870607944840576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783950924.786402:0:10360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783950924.786409:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783950924.786411:0:10360:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783950924.786415:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1783950924.786701:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1783950924.786723:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783950924.786733:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.786744:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950924.786754:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783950924.786756:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0343db6000 from 48 10000000:01000000:1.0:1783950924.786759:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783950924.786785:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.786794:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.786816:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.786833:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.786865:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950924.786891:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:10360:x1870607944840576:12345-0@lo:502:llog_process_th.0 Request processed in 758us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.786903:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783950924.786987:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.787058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840704 00000100:00100000:0.0:1783950924.787063:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840704 00000100:00100000:0.0:1783950924.787080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783950924.787085:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944840704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783950924.787103:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950924.787116:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5c600/0x7645c8e1169f806a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8063 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.787136:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5c600/0x7645c8e1169f806a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8063 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.787168:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5c600/0x7645c8e1169f806a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8063 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950924.787177:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c600, rc 0) 00000100:00100000:0.0:1783950924.787207:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944840704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.787213:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1783950924.787402:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783950924.787415:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.787425:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.787481:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.787503:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.787526:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.787659:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840832 00000100:00100000:0.0:1783950924.787663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840832 00000100:00100000:0.0:1783950924.787678:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783950924.787683:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944840832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.787783:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944840832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.787788:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783950924.787844:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.787866:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.787898:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.787916:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.787953:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944840960 00000100:00100000:0.0:1783950924.787961:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944840960 00000100:00100000:0.0:1783950924.787976:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783950924.787981:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944840960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.788055:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944840960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.788061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783950924.792089:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944840960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.794680:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10361:1870607944841088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950924.794767:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.794951:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841088 00000100:00100000:1.0:1783950924.794958:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841088 00000100:00100000:1.0:1783950924.795004:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783950924.795020:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:10361:x1870607944841088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783950924.795193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:10361:x1870607944841088:12345-0@lo:502:llog_process_th.0 Request processed in 180us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950924.795201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783950924.795428:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.795448:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10361:1870607944841088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950924.795491:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10361:1870607944841216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950924.795782:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950924.795874:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783950924.795927:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841216 00000100:00100000:1.0:1783950924.795932:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841216 00000100:00100000:1.0:1783950924.795954:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783950924.795960:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:10361:x1870607944841216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783950924.796052:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:10361:x1870607944841216:12345-0@lo:502:llog_process_th.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950924.796059:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783950924.796315:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10361:1870607944841216:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783950924.796338:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783950924.796685:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783950924.796705:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783950924.796717:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.796728:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950924.796738:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783950924.796740:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1783950924.796743:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783950924.796769:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.796778:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.796787:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.796823:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.796857:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.796879:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.797053:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841344 00000100:00100000:3.0:1783950924.797059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841344 00000100:00100000:3.0:1783950924.797110:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783950924.797118:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944841344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.797129:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950924.797172:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f8078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8071 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.797195:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f8078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8071 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.797206:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f8078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8071 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.797215:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3c00, rc 0) 00000100:00100000:3.0:1783950924.797249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944841344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.797254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783950924.797914:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783950924.797930:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.797940:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950924.798001:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.798043:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.798071:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.798187:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841472 00000100:00100000:2.0:1783950924.798192:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841472 00000100:00100000:2.0:1783950924.798232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783950924.798240:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944841472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950924.798369:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944841472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950924.798388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783950924.799007:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.799053:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783950924.799110:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950924.799138:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c600 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.799292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841600 00000100:00100000:2.0:1783950924.799297:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841600 00000100:00100000:2.0:1783950924.799323:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783950924.799331:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944841600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950924.799434:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944841600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950924.799441:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783950924.800355:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.801111:0:10362:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10362:1870607944841728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950924.801368:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950924.801504:0:10362:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1480 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.803374:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841728 00000100:00100000:2.0:1783950924.803386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841728 00000100:00100000:2.0:1783950924.803482:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783950924.803492:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:10362:x1870607944841728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950924.803846:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:10362:x1870607944841728:12345-0@lo:502:llog_process_th.0 Request processed in 355us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950924.803855:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783950924.803942:0:10362:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10362:1870607944841728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783950924.803976:0:10362:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950924.803985:0:10362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950924.803987:0:10362:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783950924.803992:0:10362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783950924.804034:0:10362:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10362:1870607944841856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950924.804075:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950924.804339:0:10362:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1783950924.804484:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841856 00000100:00100000:3.0:1783950924.804496:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841856 00000100:00100000:3.0:1783950924.804536:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1783950924.804544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:10362:x1870607944841856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950924.804649:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:10362:x1870607944841856:12345-0@lo:502:llog_process_th.0 Request processed in 106us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950924.804656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783950924.804853:0:10362:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10362:1870607944841856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783950924.804874:0:10362:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950924.804878:0:10362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950924.804880:0:10362:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783950924.804884:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783950924.805103:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1783950924.805124:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783950924.805134:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.805202:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783950924.805213:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783950924.805216:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e036d35b380 from 1 10000000:01000000:3.0:1783950924.805219:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783950924.805245:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.805254:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.805264:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.805349:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.805379:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.805445:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783950924.805498:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944841984 00000100:00100000:2.0:1783950924.805503:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944841984 00000100:00100000:1.0:1783950924.808087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783950924.808114:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944841984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783950924.808133:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950924.808173:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f8086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f807f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.808227:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f8086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f807f expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.808238:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f8086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f807f expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950924.808248:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66200, rc 0) 00000100:00100000:1.0:1783950924.808323:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944841984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950924.808331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783950924.808448:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944841984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950924.808468:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.808479:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.808567:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950924.808615:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950924.808945:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783950924.809012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842112 00000100:00100000:0.0:1783950924.809019:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842112 00000100:00100000:0.0:1783950924.809047:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783950924.809055:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944842112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783950924.809180:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944842112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783950924.809187:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783950924.809271:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944842112:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783950924.809303:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783950924.809310:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950924.809319:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950924.896869:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783950924.896896:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944842240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950924.896975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950924.897111:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842240 00000100:00100000:0.0:1783950924.897120:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842240 00000100:00100000:0.0:1783950924.897192:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783950924.897202:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944842240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783950924.897240:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783950924.897291:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944842240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950924.897298:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783950924.897342:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944842240:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783950924.897636:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950925.408689:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950925.408714:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944842368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783950925.408788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950925.409059:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842368 00000100:00100000:3.0:1783950925.409066:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842368 00000100:00100000:3.0:1783950925.409137:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783950925.409171:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944842368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783950925.409202:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950925.409259:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944842368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950925.409284:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1783950925.409403:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248015880 x1870607944842368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950925.409424:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944842368:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783950925.409482:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783950925.923341:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950925.923943:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783950925.923967:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944842496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950925.924042:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950925.924130:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842496 00000100:00100000:3.0:1783950925.924137:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842496 00000100:00100000:3.0:1783950925.924213:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783950925.924223:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944842496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783950925.924248:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950925.924296:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944842496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950925.924304:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1783950925.924348:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248015c00 x1870607944842496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950925.924367:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944842496:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783950925.924457:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783950926.944697:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950927.619232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950927.619326:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811840 00000100:00100000:3.0:1783950927.619337:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811840 00000100:00100000:3.0:1783950927.619411:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 244 00000100:00100000:3.0:1783950927.619423:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:6181:x1870607923811840:12345-192.168.202.33@tcp:101: 00010000:00010000:3.0:1783950927.619441:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950927.619462:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3600/0x7645c8e1169f808d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f490 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950927.619495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3600/0x7645c8e1169f808d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f490 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950927.619528:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3600/0x7645c8e1169f808d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f490 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950927.619539:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3600, rc 0) 00000100:00100000:3.0:1783950927.619606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923811840:12345-192.168.202.33@tcp:101: Request processed in 186us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.619613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 244 00000100:00100000:3.0:1783950927.627358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950927.627517:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923811968 00000100:00100000:1.0:1783950927.627527:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923811968 00000100:00100000:1.0:1783950927.627586:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 245 00000100:00100000:1.0:1783950927.627597:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923811968:12345-192.168.202.33@tcp:501: 00000100:00100000:1.0:1783950927.627766:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923811968:12345-192.168.202.33@tcp:501: Request processed in 168us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950927.627774:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 245 00000100:00100000:1.0:1783950927.641201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950927.641372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812096 00000100:00100000:2.0:1783950927.641385:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812096 00000100:00100000:2.0:1783950927.641452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 246 00000100:00100000:2.0:1783950927.641464:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923812096:12345-192.168.202.33@tcp:503: 00000100:00100000:2.0:1783950927.641615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923812096:12345-192.168.202.33@tcp:503: Request processed in 152us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.641624:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 246 00000100:00100000:0.0:1783950927.644876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950927.645213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812224 00000100:00100000:3.0:1783950927.645228:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812224 00000100:00100000:3.0:1783950927.645323:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 247 00000100:00100000:3.0:1783950927.645338:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6680:x1870607923812224:12345-192.168.202.33@tcp:502: 00000100:00100000:3.0:1783950927.645569:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6680:x1870607923812224:12345-192.168.202.33@tcp:502: Request processed in 234us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.645579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 247 00000100:00100000:3.0:1783950927.649802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950927.649985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812352 00000100:00100000:1.0:1783950927.649998:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812352 00000100:00100000:1.0:1783950927.650452:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 248 00000100:00100000:1.0:1783950927.650469:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6680:x1870607923812352:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783950927.650721:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6680:x1870607923812352:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 256us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950927.650731:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 248 00000100:00100000:1.0:1783950927.656086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950927.656198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812480 00000100:00100000:3.0:1783950927.656211:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812480 00000100:00100000:3.0:1783950927.656294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 249 00000100:00100000:3.0:1783950927.656307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923812480:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950927.656333:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950927.656357:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f497 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950927.656398:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f497 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950927.656448:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f497 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950927.656461:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2e00, rc 0) 00000100:00100000:3.0:1783950927.656548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923812480:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 243us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.656556:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 249 00000100:00100000:0.0:1783950927.665085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950927.665513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812608 00000100:00100000:1.0:1783950927.665528:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812608 00000100:00100000:1.0:1783950927.665606:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 250 00000100:00100000:1.0:1783950927.665620:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923812608:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950927.665924:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923812608:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 305us (866us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783950927.665935:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 250 00010000:00010000:2.0:1783950927.968517:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950927.968893:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944842624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950927.969012:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950927.969236:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842624 00000100:00100000:2.0:1783950927.969247:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842624 00000100:00100000:2.0:1783950927.969331:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783950927.969346:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944842624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950927.969398:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950927.969461:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944842624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.969470:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783950927.969607:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950927.969621:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944842752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783950927.969657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950927.969694:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842752 00000100:00100000:1.0:1783950927.969698:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842752 00000100:00100000:1.0:1783950927.969721:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783950927.969728:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944842752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783950927.969739:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783950927.969772:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944842752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950927.969778:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1783950927.969817:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28380 x1870607944842752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950927.969840:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944842752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783950927.970076:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783950927.970103:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247aa3b80 x1870607944842624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950927.970116:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944842624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950927.972732:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944843008:0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.972844:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950927.972888:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944843520:0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.972927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950927.972960:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944844032:0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.972983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950927.973017:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783950927.973024:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944843136:0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973053:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950927.973084:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944843648:0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950927.973122:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944844160:0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950927.973403:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843008 00000100:00100000:3.0:1783950927.973412:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843008 00000100:00100000:3.0:1783950927.973470:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843520 00000100:00100000:3.0:1783950927.973474:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843520 00000100:00100000:3.0:1783950927.973503:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844032 00000100:00100000:3.0:1783950927.973526:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844032 00000100:00100000:3.0:1783950927.973550:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843648 00000100:00100000:3.0:1783950927.973553:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843648 00000100:00100000:3.0:1783950927.973567:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844160 00000100:00100000:3.0:1783950927.973570:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844160 00000100:00100000:3.0:1783950927.973586:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783950927.973595:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944843008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973660:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944843008:12345-0@lo:400:kworker.0 Request processed in 65us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.973669:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783950927.973691:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783950927.973698:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944843520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973728:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944843520:12345-0@lo:400:kworker.0 Request processed in 31us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.973735:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783950927.973747:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783950927.973753:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944844032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973782:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944844032:12345-0@lo:400:kworker.0 Request processed in 30us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.973789:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783950927.973800:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783950927.973807:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944843648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973835:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944843648:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.973840:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783950927.973851:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783950927.973858:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944844160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950927.973897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944844160:12345-0@lo:400:kworker.0 Request processed in 39us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950927.973903:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783950927.974031:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944843264:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974075:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950927.974091:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944843776:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950927.974181:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783950927.974188:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944842880:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950927.974244:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944843392:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974289:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950927.974315:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944843904:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950927.974375:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843776 00000100:00100000:2.0:1783950927.974380:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843776 00000100:00100000:2.0:1783950927.974422:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843904 00000100:00100000:2.0:1783950927.974426:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843904 00000100:00100000:2.0:1783950927.974451:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783950927.974457:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944843776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974497:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944843776:12345-0@lo:400:kworker.0 Request processed in 40us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.974504:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783950927.974517:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783950927.974523:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944843904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974551:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944843904:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.974556:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783950927.974606:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248014700 x1870607944843904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950927.974622:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944843904:0@lo:400:kworker.0 00010000:00080000:2.0:1783950927.974635:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248016a00 x1870607944843776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950927.974643:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944843776:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974671:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944842880 00000100:00100000:2.0:1783950927.974674:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944842880 00000100:00100000:2.0:1783950927.974703:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1783950927.974709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944842880:12345-0@lo:400:kworker.0 Request processed in 36us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.974752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1783950927.974794:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944842880:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974850:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843136 00000100:00100000:2.0:1783950927.974855:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843136 00000100:00100000:2.0:1783950927.974876:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843392 00000100:00100000:2.0:1783950927.974879:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843392 00000100:00100000:2.0:1783950927.974892:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783950927.974898:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944843136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.974951:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944843136:12345-0@lo:400:kworker.0 Request processed in 53us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.974958:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783950927.974970:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783950927.974976:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944843392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.975010:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944843392:12345-0@lo:400:kworker.0 Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.975016:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783950927.975034:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944843264 00000100:00100000:2.0:1783950927.975037:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944843264 00000100:00100000:2.0:1783950927.975054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783950927.975059:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944843264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.975101:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944843264:12345-0@lo:400:kworker.0 Request processed in 41us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950927.975107:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783950927.975167:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944843392:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.975182:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944843264:0@lo:400:kworker.0 00000100:00080000:2.0:1783950927.975218:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783950927.975224:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783950927.975235:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783950927.975264:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944843136:0@lo:400:kworker.0 00010000:00080000:2.0:1783950927.975278:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248016680 x1870607944843648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950927.975287:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944843648:0@lo:400:kworker.0 00010000:00080000:2.0:1783950927.975299:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248017100 x1870607944844160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950927.975307:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944844160:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.975319:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944843008:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.975330:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944843520:0@lo:400:kworker.0 00000100:00100000:2.0:1783950927.975342:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944844032:0@lo:400:kworker.0 00000100:00100000:0.0:1783950927.976002:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950927.976020:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944844288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783950927.976084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950927.976247:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844288 00000100:00100000:1.0:1783950927.976254:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844288 00000100:00100000:1.0:1783950927.976299:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783950927.976308:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944844288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783950927.976345:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783950927.976407:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944844288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950927.976415:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783950927.977190:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944844288:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783950928.993615:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950929.153936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950929.153977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950929.154009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950929.154032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950929.154070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950929.154098:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813248 00000100:00100000:0.0:1783950929.154108:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813248 00000100:00100000:0.0:1783950929.154190:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813120 00000100:00100000:0.0:1783950929.154193:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813120 00000100:00100000:0.0:1783950929.154216:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:0.0:1783950929.154225:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923813248:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950929.154295:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923813248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950929.154303:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:0.0:1783950929.154319:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783950929.154342:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923813120:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950929.154365:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923813120:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950929.154371:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783950929.154389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812992 00000100:00100000:0.0:1783950929.154393:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812992 00000100:00100000:0.0:1783950929.154418:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812864 00000100:00100000:0.0:1783950929.154421:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812864 00000100:00100000:0.0:1783950929.154441:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:0.0:1783950929.154447:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923812992:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950929.154473:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923812992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950929.154480:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:0.0:1783950929.154491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:0.0:1783950929.154497:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923812864:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950929.154517:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923812864:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950929.154523:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00080000:0.0:1783950929.154541:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950929.154545:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950929.154548:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783950929.154550:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783950929.155037:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923812736 00000100:00100000:1.0:1783950929.155043:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923812736 00000100:00100000:1.0:1783950929.155096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 252 00000100:00100000:1.0:1783950929.155104:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2410:x1870607923812736:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950929.155158:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2410:x1870607923812736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 36us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950929.155166:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 252 00000020:00000080:3.0:1783950929.606400:0:10400:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1026e9e0 20000000:00000080:3.0:1783950929.606438:0:10400:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e037d1a7000 uarg=0000000000000000 20000000:01000000:3.0:1783950929.606499:0:10400:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783950929.606507:0:10400:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783950929.606513:0:10400:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783950929.607857:0:10401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783950929.608395:0:10400:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783950929.615585:0:10400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783950929.615886:0:10400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783950929.616522:0:10400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783950929.616556:0:10400:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783950929.616583:0:10400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.616608:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.616694:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.616704:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.616712:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.616725:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.616761:0:10400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.617427:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.617454:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 9 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.617475:0:10400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844416:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783950929.617643:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.617652:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 23 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.617662:0:10400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844544:0@lo:104: 00000100:00100000:3.0:1783950929.617719:0:10400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950929.617768:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.617780:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 23 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.617792:0:10400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844672:0@lo:104: 00000100:00100000:2.0:1783950929.617800:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844544 00000100:00100000:2.0:1783950929.617819:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844544 00000100:00100000:3.0:1783950929.617828:0:10400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950929.621670:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.621718:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 23 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.621735:0:10400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844800:0@lo:104: 00010000:00010000:3.0:1783950929.621814:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.621822:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 23 pid: 6520 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.621830:0:10400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844928:0@lo:104: 00000100:00100000:3.0:1783950929.621852:0:10400:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950929.622591:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783950929.622649:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950929.626769:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844672 00000100:00100000:2.0:1783950929.626831:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950929.626853:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844672 00000100:00100000:2.0:1783950929.626854:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844800 00000100:00100000:2.0:1783950929.626866:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844800 00000100:00100000:2.0:1783950929.626933:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944844928 00000100:00100000:2.0:1783950929.626936:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944844928 00000100:00100000:2.0:1783950929.626958:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783950929.626968:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+6:10400:x1870607944844544:12345-0@lo:104: 00000100:00100000:3.0:1783950929.627120:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1783950929.627122:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.627167:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+6:10400:x1870607944844800:12345-0@lo:104: 00010000:00010000:3.0:1783950929.627188:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.627267:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783950929.627293:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+6:10400:x1870607944844544:12345-0@lo:104: Request processed in 325us (9573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950929.627303:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1783950929.627313:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783950929.627323:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1065061-5fe9-438e-843f-5f70939080ee+5:10400:x1870607944844800:12345-0@lo:104: Request processed in 189us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950929.627333:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783950929.627345:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:10400:x1870607944844928:12345-0@lo:104: 00010000:00010000:2.0:1783950929.627355:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.627413:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783950929.627419:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:10400:x1870607944844928:12345-0@lo:104: Request processed in 77us (596us total) trans 0 rc 0/0 00010000:00010000:0.0:1783950929.627532:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783950929.627541:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627550:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950929.627564:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627574:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950929.627583:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950929.627588:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783950929.627649:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627656:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783950929.627681:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627688:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382144000/0x7645c8e1169f7eb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7ebf expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627708:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783950929.627711:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627716:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950929.627719:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627725:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950929.627740:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950929.627746:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783950929.627761:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627766:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783950929.627784:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627791:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f7d3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627801:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783950929.627804:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627809:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783950929.627812:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627818:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783950929.627824:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950929.627829:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783950929.627850:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627856:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783950929.627861:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627868:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2000/0x7645c8e1169f7d30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.627876:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950929.627877:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950929.627878:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950929.627905:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944845056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783950929.627955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950929.628012:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944845184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783950929.628034:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950929.628061:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950929.628066:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944845312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783950929.628084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950929.628112:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845056 00000100:00100000:0.0:1783950929.628118:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845056 00010000:00010000:0.0:1783950929.628161:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 24 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950929.628179:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845184 00000100:00100000:0.0:1783950929.628181:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845184 00010000:00010000:0.0:1783950929.628191:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 25 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950929.628217:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845312 00000100:00100000:0.0:1783950929.628220:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845312 00010000:00010000:0.0:1783950929.628229:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 26 pid: 6520 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950929.628238:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783950929.628244:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+26:3653:x1870607944845056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783950929.628256:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783950929.628261:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 26 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950929.628271:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 26 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.628381:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783950929.628630:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783950929.628641:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783950929.628657:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348bca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10400:x1870607944844672:12345-0@lo:104: 00010000:00010000:1.0:1783950929.628671:0:7466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950929.628731:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783950929.628736:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348bca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d1065061-5fe9-438e-843f-5f70939080ee+3:10400:x1870607944844672:12345-0@lo:104: Request processed in 86us (10915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950929.628744:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1783950929.628776:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783950929.628786:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950929.628826:0:10400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844416:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783950929.628841:0:10400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844544:0@lo:104: 00000100:00100000:3.0:1783950929.628849:0:10400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844672:0@lo:104: 00000100:00100000:3.0:1783950929.628858:0:10400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844800:0@lo:104: 00000100:00100000:3.0:1783950929.628866:0:10400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1870607944844928:0@lo:104: 00010000:00010000:0.0:1783950929.629118:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2a00/0x7645c8e1169f7ebf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7eb8 expref: 26 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950929.629480:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783950929.629492:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1783950929.629709:0:10400:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.629859:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783950929.629868:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950929.629872:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950929.629885:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950929.629895:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950929.629901:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783950929.629958:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.629982:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950929.630024:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630032:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c2a00/0x7645c8e1169f7d92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f7d99 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630064:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950929.630066:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950929.630068:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950929.630168:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944845440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783950929.630237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950929.630348:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783950929.630359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845440 00000100:00100000:2.0:1783950929.630365:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845440 00010000:00010000:2.0:1783950929.630390:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 26 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950929.630411:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783950929.630418:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783950929.630427:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+26:3654:x1870607944845184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783950929.630443:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950929.630449:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 26 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630461:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 26 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630476:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f7d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7d3e expref: 26 pid: 6519 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630503:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950929.630580:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+25:3654:x1870607944845184:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (2544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950929.630588:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783950929.630605:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783950929.630612:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950929.630618:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944845312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783950929.630626:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950929.630642:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 24 pid: 6520 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630650:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 24 pid: 6520 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630660:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f7d37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7d30 expref: 24 pid: 6520 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630670:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950929.630697:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+23:3654:x1870607944845312:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950929.630704:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950929.630715:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783950929.630721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783950929.630728:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+22:3652:x1870607944845440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783950929.630735:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950929.630740:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 22 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630762:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 22 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630776:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030a00/0x7645c8e1169f7d99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f7d92 expref: 22 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.630787:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950929.630855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+21:3652:x1870607944845440:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950929.630863:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783950929.630903:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944845440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783950929.630922:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950929.631035:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783950929.631130:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+20:3653:x1870607944845056:12345-0@lo:103:ldlm_bl.0 Request processed in 2881us (3170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950929.631163:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783950929.631258:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944845056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783950929.631372:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944845184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783950929.631392:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944845312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783950929.640386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950929.640471:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813376 00000100:00100000:2.0:1783950929.640486:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813376 00010000:00010000:2.0:1783950929.640550:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 10 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950929.640601:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:2.0:1783950929.640611:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923813376:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783950929.640627:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950929.640705:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 10 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640720:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 10 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640795:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67000/0x7645c8e1169f7fd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f458 expref: 10 pid: 6517 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640830:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640839:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640857:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640864:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640871:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640878:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640885:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783950929.640889:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640897:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640910:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.640922:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950929.641135:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:2408:x1870607923813376:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 524us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950929.641176:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00010000:00010000:2.0:1783950929.646408:0:10400:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.646434:0:10400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950929.646442:0:10400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f809b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950930.016623:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950930.016655:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944845568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950930.016756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950930.016845:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845568 00000100:00100000:3.0:1783950930.016855:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845568 00000100:00100000:3.0:1783950930.016923:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783950930.016935:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944845568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783950930.016984:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950930.017040:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944845568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950930.017060:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783950930.017125:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944845568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783950930.018987:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950930.529378:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944845696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783950930.529560:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950930.530126:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845696 00000100:00100000:3.0:1783950930.530138:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845696 00000100:00100000:3.0:1783950930.530243:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783950930.530259:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944845696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783950930.530303:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950930.530398:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944845696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950930.530407:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1783950930.530436:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950930.530476:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0381128000 x1870607944845696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950930.530512:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944845696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783950931.012452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950931.012911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813504 00000100:00100000:2.0:1783950931.012926:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813504 00000100:00100000:2.0:1783950931.012998:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 253 00000100:00100000:2.0:1783950931.013023:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:6181:x1870607923813504:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783950931.013055:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950931.013084:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f49e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.013121:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.013135:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.013175:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948a00, rc 0) 00000100:00100000:2.0:1783950931.013260:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923813504:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 250us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.013268:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 253 00000100:00100000:0.0:1783950931.015568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950931.015665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813632 00000100:00100000:3.0:1783950931.015677:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813632 00000100:00100000:3.0:1783950931.015748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 254 00000100:00100000:3.0:1783950931.015761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923813632:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.015979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923813632:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 219us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.015989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 254 00000100:00100000:0.0:1783950931.020483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950931.020734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813760 00000100:00100000:3.0:1783950931.020746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813760 00000100:00100000:3.0:1783950931.020918:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 255 00000100:00100000:3.0:1783950931.020931:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923813760:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.021188:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6181:x1870607923813760:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 257us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.021197:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 255 00000100:00100000:0.0:1783950931.031060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950931.032677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923813888 00000100:00100000:3.0:1783950931.032705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923813888 00000100:00100000:3.0:1783950931.032810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 256 00000100:00100000:3.0:1783950931.032826:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6737:x1870607923813888:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783950931.033082:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6737:x1870607923813888:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 258us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.033092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 256 00000100:00100000:0.0:1783950931.037968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950931.038176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814016 00000100:00100000:3.0:1783950931.038194:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814016 00000100:00100000:3.0:1783950931.038281:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 257 00000100:00100000:3.0:1783950931.038308:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6737:x1870607923814016:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783950931.038533:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:6737:x1870607923814016:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 215us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.038543:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 257 00010000:00010000:2.0:1783950931.040838:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950931.047181:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944845824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950931.047308:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.047784:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845824 00000100:00100000:0.0:1783950931.047803:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845824 00000100:00100000:0.0:1783950931.048089:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950931.048106:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944845824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783950931.048173:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950931.048247:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944845824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (938us total) trans 0 rc 0/0 00000100:00080000:2.0:1783950931.049081:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950931.049257:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248012a00 x1870607944845824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950931.049291:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944845824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783950931.049478:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 10000000:01000000:3.0:1783950931.104396:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783950931.104410:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0241aa4000 from 4 10000000:01000000:3.0:1783950931.104418:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783950931.104497:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.104513:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.104528:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950931.104569:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944845952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.104673:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950931.104819:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88840 going to sleep for 11 seconds 00000100:00100000:1.0:1783950931.106324:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944845952 00000100:00100000:1.0:1783950931.106342:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944845952 00000100:00100000:1.0:1783950931.111218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783950931.111248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944845952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783950931.111276:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783950931.111520:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f80a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950931.111562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950931.111582:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950931.111594:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783950931.111717:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944845952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 482us (7044us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950931.111726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783950931.111887:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944845952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783950931.111915:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.111928:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950931.112033:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.112086:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.112130:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783950931.112261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846080 00000100:00100000:1.0:1783950931.112282:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846080 00000100:00100000:1.0:1783950931.112320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783950931.112327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944846080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950931.112465:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944846080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950931.112472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783950931.112931:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.112971:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.113016:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.113053:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783950931.113102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846208 00000100:00100000:1.0:1783950931.113107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846208 00000100:00100000:1.0:1783950931.113158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783950931.113165:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944846208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783950931.113260:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944846208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950931.113266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783950931.113389:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.114392:0:10451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10451:1870607944846336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.114458:0:10451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.114553:0:10451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950931.114710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846336 00000100:00100000:3.0:1783950931.114726:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846336 00000100:00100000:3.0:1783950931.114781:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783950931.114791:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:10451:x1870607944846336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950931.114989:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:10451:x1870607944846336:12345-0@lo:502:llog_process_th.0 Request processed in 198us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.114998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783950931.115626:0:10451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10451:1870607944846336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783950931.115667:0:10451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950931.115681:0:10451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950931.115684:0:10451:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783950931.115693:0:10451:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0241aa4000 00000020:00000080:2.0:1783950931.115696:0:10451:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783950931.115906:0:10451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10451:1870607944846464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.115972:0:10451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.116233:0:10451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950931.116272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846464 00000100:00100000:0.0:1783950931.116280:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846464 00000100:00100000:0.0:1783950931.116331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783950931.116343:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:10451:x1870607944846464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950931.116750:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:10451:x1870607944846464:12345-0@lo:502:llog_process_th.0 Request processed in 409us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950931.116759:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783950931.119320:0:10451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10451:1870607944846464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783950931.119384:0:10451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950931.119397:0:10451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950931.119400:0:10451:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783950931.119406:0:10451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783950931.119988:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783950931.120018:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783950931.120033:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950931.120055:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950931.120067:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783950931.120070:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377952800 from 4 10000000:01000000:1.0:1783950931.120074:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783950931.120123:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950931.120132:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950931.120177:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950931.120207:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783950931.120299:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.120342:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846592 00000100:00100000:1.0:1783950931.120351:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416240 going to sleep for 11 seconds 00000100:00100000:2.0:1783950931.120352:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846592 00000100:00100000:2.0:1783950931.120559:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783950931.120573:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944846592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783950931.120592:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950931.120611:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f80b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.120643:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.120657:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.120668:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948c00, rc 0) 00000100:00100000:2.0:1783950931.120733:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944846592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.120742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783950931.120832:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950931.120848:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.120859:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950931.120940:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.120970:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950931.125852:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88900 going to sleep for 11 seconds 00000100:00100000:1.0:1783950931.127066:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846720 00000100:00100000:1.0:1783950931.127082:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846720 00000100:00100000:1.0:1783950931.127171:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783950931.127185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944846720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783950931.132552:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944846720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5353us (11563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950931.132574:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783950931.146434:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.146529:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.146635:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950931.146704:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88900 going to sleep for 11 seconds 00000100:00100000:0.0:1783950931.147633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846848 00000100:00100000:0.0:1783950931.147659:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846848 00000100:00100000:0.0:1783950931.147738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783950931.147750:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944846848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.148077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944846848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950931.148087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783950931.148188:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944846848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.153761:0:10454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10454:1870607944846976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950931.154010:0:10454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.154078:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944846976 00000100:00100000:0.0:1783950931.154087:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944846976 00000100:00100000:0.0:1783950931.154165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783950931.154175:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:10454:x1870607944846976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950931.154329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:10454:x1870607944846976:12345-0@lo:502:llog_process_th.0 Request processed in 154us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950931.154337:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783950931.154404:0:10454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950931.154432:0:10454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10454:1870607944846976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783950931.154466:0:10454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950931.154479:0:10454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950931.155602:0:10454:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783950931.155625:0:10454:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0377952800 00000020:00000080:0.0:1783950931.155629:0:10454:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783950931.156755:0:10454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10454:1870607944847104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950931.157680:0:10454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.157743:0:10454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783950931.159074:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847104 00000100:00100000:3.0:1783950931.159092:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847104 00000100:00100000:3.0:1783950931.159334:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783950931.159348:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:10454:x1870607944847104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950931.159575:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:10454:x1870607944847104:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.159594:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783950931.161719:0:10454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10454:1870607944847104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783950931.161853:0:10454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783950931.161866:0:10454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950931.161869:0:10454:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783950931.161873:0:10454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783950931.162130:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783950931.162185:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783950931.162199:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.162213:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783950931.162234:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783950931.162237:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 4 10000000:01000000:0.0:1783950931.162241:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783950931.162288:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.162297:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.162307:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950931.162334:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.162414:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.162458:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950931.162842:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847232 00000100:00100000:0.0:1783950931.162853:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847232 00000100:00100000:0.0:1783950931.162999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783950931.163010:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944847232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783950931.163028:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783950931.163055:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f80c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.163087:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.163100:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.163124:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783950931.163209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944847232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950931.163217:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783950931.163272:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783950931.163290:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783950931.163300:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783950931.163373:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.163403:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.163427:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950931.163441:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847360 00000100:00100000:0.0:1783950931.163444:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847360 00000100:00100000:0.0:1783950931.164616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783950931.164647:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944847360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.165655:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944847360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1019us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950931.165667:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783950931.165751:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.165979:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.166045:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.166089:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783950931.166106:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847488 00000100:00100000:0.0:1783950931.166114:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847488 00000100:00100000:0.0:1783950931.166171:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783950931.166178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944847488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783950931.166290:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944847488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950931.166298:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783950931.166343:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783950931.170345:0:10455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10455:1870607944847616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950931.170492:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950931.170562:0:10455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d883c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783950931.180324:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847616 00000100:00100000:2.0:1783950931.180352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847616 00000100:00100000:2.0:1783950931.180435:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783950931.180449:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:10455:x1870607944847616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.180708:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:10455:x1870607944847616:12345-0@lo:502:llog_process_th.0 Request processed in 261us (10215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.180717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783950931.180825:0:10455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10455:1870607944847616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783950931.180995:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783950931.181010:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783950931.181013:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783950931.181021:0:10455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0377b14000 00000020:00000080:0.0:1783950931.181024:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783950931.181189:0:10455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10455:1870607944847744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783950931.181246:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950931.181289:0:10455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413300 going to sleep for 11 seconds 00000100:00100000:3.0:1783950931.181924:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847744 00000100:00100000:3.0:1783950931.181933:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847744 00000100:00100000:3.0:1783950931.181982:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783950931.181993:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:10455:x1870607944847744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783950931.182190:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:10455:x1870607944847744:12345-0@lo:502:llog_process_th.0 Request processed in 199us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.182199:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783950931.183629:0:10455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248010380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10455:1870607944847744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783950931.183700:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783950931.183710:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783950931.183713:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783950931.183719:0:10455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783950931.184507:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783950931.184552:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783950931.184567:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.184581:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950931.184595:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783950931.184598:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db6000 from 4 10000000:01000000:2.0:1783950931.184602:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783950931.184648:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.184657:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.184667:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950931.184696:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.184781:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.184834:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c480 going to sleep for 11 seconds 00000100:00100000:3.0:1783950931.185459:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944847872 00000100:00100000:3.0:1783950931.185470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944847872 00000100:00100000:3.0:1783950931.185605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783950931.185619:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944847872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783950931.185638:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783950931.185658:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f80d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.185692:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.185704:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.185713:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3800, rc 0) 00000100:00100000:3.0:1783950931.185788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944847872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950931.185804:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783950931.186666:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944847872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783950931.186697:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950931.186717:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950931.186817:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944848000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.186872:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.186915:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783950931.186934:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848000 00000100:00100000:2.0:1783950931.186939:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848000 00000100:00100000:2.0:1783950931.186979:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783950931.186987:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944848000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.187182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944848000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.187189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783950931.187234:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944848000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.187287:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944848128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.187334:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.187353:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783950931.187364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848128 00000100:00100000:2.0:1783950931.187367:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848128 00000100:00100000:2.0:1783950931.187392:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1783950931.187399:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944848128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.187489:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944848128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.187496:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1783950931.187545:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944848128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783950931.187808:0:10457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10457:1870607944848256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.187848:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.187868:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848256 00000100:00100000:2.0:1783950931.187871:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848256 00000100:00100000:2.0:1783950931.187893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783950931.187900:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:10457:x1870607944848256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.187977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:10457:x1870607944848256:12345-0@lo:502:llog_process_th.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.187985:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783950931.188016:0:10457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c840 going to sleep for 11 seconds 00000100:00100000:2.0:1783950931.188028:0:10457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10457:1870607944848256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783950931.190956:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783950931.190978:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950931.190981:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783950931.190990:0:10457:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0343db6000 00000020:00000080:2.0:1783950931.190994:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783950931.191138:0:10457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10457:1870607944848384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.191467:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950931.191764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848384 00000100:00100000:2.0:1783950931.191775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848384 00000100:00100000:2.0:1783950931.191901:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1783950931.191911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:10457:x1870607944848384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783950931.192087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:10457:x1870607944848384:12345-0@lo:502:llog_process_th.0 Request processed in 176us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950931.192097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1783950931.192183:0:10457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783950931.192214:0:10457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:10457:1870607944848384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783950931.192246:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783950931.192253:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783950931.192395:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783950931.192402:0:10457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783950931.193113:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783950931.193239:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783950931.193445:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950931.193461:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950932.072563:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950933.090041:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950933.094106:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944848768:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094237:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.094308:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944849280:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094337:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.094365:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944849792:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094388:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.094429:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783950933.094436:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944848896:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.094478:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944849408:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094503:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.094526:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944849920:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.094593:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848768 00000100:00100000:1.0:1783950933.094602:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848768 00000100:00100000:1.0:1783950933.094662:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783950933.094672:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944848768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094735:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944848768:12345-0@lo:400:kworker.0 Request processed in 63us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950933.094743:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783950933.094771:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849280 00000100:00100000:1.0:1783950933.094775:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849280 00000100:00100000:1.0:1783950933.094811:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849792 00000100:00100000:1.0:1783950933.094814:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849792 00000100:00100000:1.0:1783950933.094831:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848896 00000100:00100000:1.0:1783950933.094834:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848896 00000100:00100000:1.0:1783950933.094847:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783950933.094853:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944849280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094883:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944849280:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950933.094888:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783950933.094900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783950933.094906:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944849792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094939:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944849792:12345-0@lo:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950933.094944:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783950933.094955:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783950933.094960:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.094984:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944848896:12345-0@lo:400:kworker.0 Request processed in 24us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950933.094988:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783950933.095343:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944848512:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095410:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944849024:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095445:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944849536:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095480:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944850048:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095513:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783950933.095518:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944848640:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095556:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944849152:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095574:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095586:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944849664:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095604:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950933.095639:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848640 00000100:00100000:3.0:1783950933.095643:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848640 00000100:00100000:3.0:1783950933.095669:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849152 00000100:00100000:3.0:1783950933.095672:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849152 00000100:00100000:3.0:1783950933.095684:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849664 00000100:00100000:3.0:1783950933.095686:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849664 00000100:00100000:3.0:1783950933.095700:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783950933.095706:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944848640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095743:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944848640:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950933.095749:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783950933.095762:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783950933.095767:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944849152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095790:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944849152:12345-0@lo:400:kworker.0 Request processed in 23us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950933.095796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783950933.095805:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783950933.095811:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944849664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095830:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944849664:12345-0@lo:400:kworker.0 Request processed in 19us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950933.095835:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783950933.095881:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944848640:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095890:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944849152:0@lo:400:kworker.0 00000100:00100000:3.0:1783950933.095898:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944849664:0@lo:400:kworker.0 00000100:00080000:2.0:1783950933.096088:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783950933.096095:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783950933.096108:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944848512 00000100:00100000:2.0:1783950933.096112:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944848512 00000100:00100000:2.0:1783950933.096161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783950933.096168:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944848512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950933.096209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944848512:12345-0@lo:400:kworker.0 Request processed in 42us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950933.096215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783950933.096252:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944848512:0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.096453:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849408 00000100:00100000:0.0:1783950933.096458:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849408 00000100:00100000:0.0:1783950933.096487:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849920 00000100:00100000:0.0:1783950933.096490:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849920 00000100:00100000:0.0:1783950933.096500:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849536 00000100:00100000:0.0:1783950933.096503:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849536 00000100:00100000:0.0:1783950933.096513:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850048 00000100:00100000:0.0:1783950933.096516:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850048 00000100:00100000:0.0:1783950933.096527:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783950933.096533:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944849408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.096584:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944849408:12345-0@lo:400:kworker.0 Request processed in 50us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950933.096590:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783950933.096602:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783950933.096608:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944849920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.096634:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944849920:12345-0@lo:400:kworker.0 Request processed in 26us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950933.096639:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783950933.096650:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783950933.096656:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944849536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.096689:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944849536:12345-0@lo:400:kworker.0 Request processed in 33us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950933.096695:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783950933.096705:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783950933.096711:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.096738:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944850048:12345-0@lo:400:kworker.0 Request processed in 27us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950933.096744:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783950933.096828:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944850176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950933.096858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950933.096992:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944850432:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783950933.097031:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783950933.097034:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950933.097059:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2bb80 x1870607944849536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950933.097074:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944849536:0@lo:400:kworker.0 00010000:00080000:2.0:1783950933.097083:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29880 x1870607944850048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950933.097091:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944850048:0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.097266:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944849024 00000100:00100000:0.0:1783950933.097272:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944849024 00000100:00100000:0.0:1783950933.097301:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783950933.097307:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944849024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950933.097347:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944849024:12345-0@lo:400:kworker.0 Request processed in 40us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950933.097361:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783950933.098009:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.098266:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944848896:0@lo:400:kworker.0 00010000:00080000:1.0:1783950933.098291:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28000 x1870607944849408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950933.098301:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944849408:0@lo:400:kworker.0 00010000:00080000:1.0:1783950933.098314:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2b480 x1870607944849920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950933.098322:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944849920:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.098335:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944848768:0@lo:400:kworker.0 00010000:00080000:1.0:1783950933.098348:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28380 x1870607944849280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950933.098357:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944849280:0@lo:400:kworker.0 00010000:00080000:1.0:1783950933.098368:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29500 x1870607944849792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950933.098375:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944849792:0@lo:400:kworker.0 00000100:00100000:1.0:1783950933.098421:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944850304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783950933.098461:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950933.098507:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850304 00000100:00100000:1.0:1783950933.098512:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850304 00000100:00100000:1.0:1783950933.098544:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783950933.098550:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944850304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783950933.098585:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783950933.098625:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944850304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950933.098632:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783950933.098667:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944850304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783950933.098711:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944849024:0@lo:400:kworker.0 00000100:00100000:2.0:1783950933.115663:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850176 00000100:00100000:2.0:1783950933.115710:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850176 00000100:00100000:2.0:1783950933.115785:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850432 00000100:00100000:2.0:1783950933.115789:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850432 00000100:00100000:2.0:1783950933.115816:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783950933.115827:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944850176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783950933.115971:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950933.116106:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944850176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 280us (19245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950933.116114:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783950933.116135:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783950933.116161:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944850432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950933.116172:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950933.116206:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944850432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (18200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950933.116212:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1783950933.116330:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248012300 x1870607944850176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950933.116365:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944850176:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783950933.116419:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e5c00 x1870607944850432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950933.116433:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944850432:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783950934.112818:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950934.288000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950934.288057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950934.288094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950934.288114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950934.288162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950934.288487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814144 00000100:00100000:3.0:1783950934.288502:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814144 00000100:00100000:3.0:1783950934.288664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 279 00000100:00100000:3.0:1783950934.288750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923814144:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950934.290079:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923814144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1392us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950934.290095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 279 00000100:00100000:0.0:1783950934.290503:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814400 00000100:00100000:0.0:1783950934.290523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814400 00000100:00100000:0.0:1783950934.291433:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814272 00000100:00100000:0.0:1783950934.291443:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814272 00000100:00100000:0.0:1783950934.291497:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:0.0:1783950934.291512:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923814400:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950934.291621:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923814400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (3563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950934.291629:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:0.0:1783950934.291647:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:0.0:1783950934.291654:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923814272:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950934.291690:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923814272:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 36us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950934.291697:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:0.0:1783950934.291725:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814656 00000100:00100000:0.0:1783950934.291729:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814656 00000100:00100000:0.0:1783950934.291757:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814528 00000100:00100000:0.0:1783950934.291760:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814528 00000100:00100000:0.0:1783950934.291781:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:0.0:1783950934.291787:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923814656:12345-192.168.202.33@tcp:400:kworker.0 00000100:00080000:2.0:1783950934.293084:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783950934.293094:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783950934.293098:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783950934.293101:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783950934.293621:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923814656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1828us (5520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950934.293634:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:0.0:1783950934.293693:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:0.0:1783950934.293707:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923814528:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950934.293736:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923814528:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 35us (5573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950934.293742:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1783950935.136290:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944850560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950935.136385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950935.136495:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850560 00000100:00100000:3.0:1783950935.136504:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850560 00000100:00100000:3.0:1783950935.137066:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783950935.137079:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944850560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783950935.137130:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950935.137231:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944850560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950935.137239:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783950935.137307:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944850560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783950935.139347:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950935.649392:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944850688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783950935.649595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950935.651002:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850688 00000100:00100000:2.0:1783950935.651018:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850688 00000100:00100000:2.0:1783950935.651082:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783950935.651093:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944850688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783950935.651138:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783950935.652438:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950935.661085:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2bb80 x1870607944850688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950935.661123:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944850688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950935.664593:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944850688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13485us (14982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950935.664613:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1783950936.160381:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950936.162077:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944850816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783950936.162201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950936.162741:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850816 00000100:00100000:2.0:1783950936.162753:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850816 00000100:00100000:2.0:1783950936.162830:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783950936.162912:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944850816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783950936.162946:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950936.163022:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944850816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950936.163031:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1783950936.163236:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783950936.163278:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e1180 x1870607944850816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950936.163303:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944850816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783950937.185946:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783950937.474134:0:10701:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1783950938.212111:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950938.213308:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944850944:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213414:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213484:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944851456:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213512:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213530:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944851968:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213551:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213563:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944852480:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213579:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213604:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783950938.213610:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944851328:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213635:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213655:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944851840:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213689:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213710:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944852352:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213728:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.213765:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944850944 00000100:00100000:1.0:1783950938.213774:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944850944 00000100:00100000:1.0:1783950938.213832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783950938.213843:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944850944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.213906:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944850944:12345-0@lo:400:kworker.0 Request processed in 64us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950938.213914:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783950938.213952:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851328 00000100:00100000:1.0:1783950938.213956:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851328 00000100:00100000:1.0:1783950938.213995:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783950938.214003:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944851328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.214040:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944851328:12345-0@lo:400:kworker.0 Request processed in 38us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950938.214057:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783950938.214077:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851456 00000100:00100000:1.0:1783950938.214081:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851456 00000100:00100000:1.0:1783950938.214101:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851840 00000100:00100000:1.0:1783950938.214103:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851840 00000100:00100000:1.0:1783950938.214125:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852352 00000100:00100000:1.0:1783950938.214127:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852352 00000100:00100000:1.0:1783950938.214137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783950938.214170:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944851456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.214201:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944851456:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950938.214207:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783950938.214217:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783950938.214493:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944851072:0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.214530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950938.214545:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944851584:0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.214565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950938.214581:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944852096:0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.214603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950938.214623:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944852608:0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.214661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.215942:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944851840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.216041:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944851840:12345-0@lo:400:kworker.0 Request processed in 119us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950938.216049:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783950938.216084:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851072 00000100:00100000:1.0:1783950938.216092:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851072 00000100:00100000:1.0:1783950938.216121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783950938.216127:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944852352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.216177:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944852352:12345-0@lo:400:kworker.0 Request processed in 50us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950938.216183:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783950938.216197:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783950938.216203:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944851072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950938.216581:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944851200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950938.216634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950938.216659:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944851712:0@lo:400:kworker.0 00000100:00100000:3.0:1783950938.216684:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950938.216695:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944852224:0@lo:400:kworker.0 00000100:00100000:3.0:1783950938.216716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950938.217506:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944852736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950938.217545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950938.217584:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852736 00000100:00100000:2.0:1783950938.217592:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852736 00000100:00100000:2.0:1783950938.217639:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783950938.217648:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944852736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950938.217677:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950938.217717:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944852736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950938.217725:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1783950938.217769:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2aa00 x1870607944852736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950938.217791:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944852736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950938.217958:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851712 00000100:00100000:0.0:1783950938.217962:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851712 00000100:00100000:0.0:1783950938.217999:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852224 00000100:00100000:0.0:1783950938.218002:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852224 00000100:00100000:0.0:1783950938.218021:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783950938.218028:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944851712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218077:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944851712:12345-0@lo:400:kworker.0 Request processed in 49us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218094:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783950938.218107:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783950938.218112:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944852224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218161:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944852224:12345-0@lo:400:kworker.0 Request processed in 28us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218168:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783950938.218188:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851968 00000100:00100000:0.0:1783950938.218192:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851968 00000100:00100000:0.0:1783950938.218212:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852480 00000100:00100000:0.0:1783950938.218227:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852480 00000100:00100000:0.0:1783950938.218239:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852096 00000100:00100000:0.0:1783950938.218241:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852096 00000100:00100000:0.0:1783950938.218252:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852608 00000100:00100000:0.0:1783950938.218254:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852608 00000100:00100000:0.0:1783950938.218266:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783950938.218271:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944851968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218302:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944851968:12345-0@lo:400:kworker.0 Request processed in 31us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218308:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783950938.218317:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950938.218323:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218345:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944852480:12345-0@lo:400:kworker.0 Request processed in 23us (4765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218350:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783950938.218358:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783950938.218363:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218399:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944852096:12345-0@lo:400:kworker.0 Request processed in 35us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218404:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783950938.218414:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783950938.218420:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944852608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218443:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944852608:12345-0@lo:400:kworker.0 Request processed in 24us (3782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218449:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783950938.218530:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851584 00000100:00100000:0.0:1783950938.218534:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851584 00000100:00100000:0.0:1783950938.218554:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944851200 00000100:00100000:0.0:1783950938.218557:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944851200 00000100:00100000:0.0:1783950938.218571:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783950938.218577:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944851584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.218614:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944851584:12345-0@lo:400:kworker.0 Request processed in 36us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218619:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783950938.218630:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783950938.218637:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944851200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783950938.218664:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783950938.218695:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944851200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950938.218701:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783950938.218812:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944851200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950938.218827:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944851712:0@lo:400:kworker.0 00000100:00100000:2.0:1783950938.218838:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944852224:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.226070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944851072:12345-0@lo:400:kworker.0 Request processed in 9847us (11519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950938.226092:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1783950938.226193:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783950938.226201:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783950938.226205:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783950938.226209:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783950938.229060:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944852864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783950938.229208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950938.229469:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944851328:0@lo:400:kworker.0 00010000:00080000:1.0:1783950938.229492:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e2d80 x1870607944851840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950938.229505:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944851840:0@lo:400:kworker.0 00010000:00080000:1.0:1783950938.229518:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024792bb80 x1870607944852352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950938.229526:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944852352:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.229536:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944850944:0@lo:400:kworker.0 00000100:00100000:1.0:1783950938.229550:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944851456:0@lo:400:kworker.0 00010000:00080000:1.0:1783950938.229562:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247928e00 x1870607944851968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950938.229571:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944851968:0@lo:400:kworker.0 00010000:00080000:1.0:1783950938.229581:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024792b480 x1870607944852480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950938.229617:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944852480:0@lo:400:kworker.0 00000100:00100000:2.0:1783950938.229855:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852864 00000100:00100000:2.0:1783950938.229865:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852864 00000100:00100000:2.0:1783950938.229934:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950938.229945:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944852864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783950938.230007:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950938.230078:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944852864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950938.230085:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1783950938.233461:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0aa00 x1870607944852864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950938.233503:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944852864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950938.238440:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944851072:0@lo:400:kworker.0 00000100:00100000:0.0:1783950938.238467:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944851584:0@lo:400:kworker.0 00010000:00080000:0.0:1783950938.238516:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247929f80 x1870607944852096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950938.238528:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944852096:0@lo:400:kworker.0 00010000:00080000:0.0:1783950938.238539:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024792b100 x1870607944852608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950938.238548:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944852608:0@lo:400:kworker.0 00010000:00010000:1.0:1783950939.233046:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950939.402357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950939.402399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950939.402438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950939.402466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950939.402496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950939.402531:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814784 00000100:00100000:0.0:1783950939.402544:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814784 00000100:00100000:0.0:1783950939.402607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 281 00000100:00100000:0.0:1783950939.402620:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923814784:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950939.402707:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923814784:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950939.402716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 281 00000100:00100000:0.0:1783950939.402754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923814912 00000100:00100000:0.0:1783950939.402757:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923814912 00000100:00100000:0.0:1783950939.402792:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815040 00000100:00100000:0.0:1783950939.402795:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815040 00000100:00100000:0.0:1783950939.402831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:0.0:1783950939.402847:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923814912:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950939.402882:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923814912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 44us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950939.402897:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:0.0:1783950939.402910:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 90 00000100:00100000:0.0:1783950939.402916:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923815040:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950939.402939:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923815040:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950939.402945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 90 00000100:00100000:0.0:1783950939.403127:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815168 00000100:00100000:0.0:1783950939.403132:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815168 00000100:00100000:0.0:1783950939.403203:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815296 00000100:00100000:0.0:1783950939.403207:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815296 00000100:00100000:0.0:1783950939.403226:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783950939.403233:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2406:x1870607923815168:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:0.0:1783950939.403262:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7fec 00000100:00080000:0.0:1783950939.403272:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e037e5df800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783950939.403325:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783950939.404083:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+2:2406:x1870607923815168:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 843us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950939.404094:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783950939.404486:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783950939.404498:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2406:x1870607923815296:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:0.0:1783950939.404524:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7ff3 00000100:00080000:0.0:1783950939.404535:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e037fc0f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783950939.404581:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783950939.404671:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+2:2406:x1870607923815296:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 176us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950939.404690:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00080000:0.0:1783950939.407576:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783950939.407587:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783950939.407592:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950939.407595:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783950939.407698:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783950939.407706:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950940.258431:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950940.258469:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944852992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950940.258577:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950940.259264:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944852992 00000100:00100000:0.0:1783950940.259277:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944852992 00000100:00100000:0.0:1783950940.259345:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783950940.259355:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944852992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783950940.259411:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783950940.259491:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944852992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950940.259500:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783950940.259607:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944852992:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783950940.264157:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950940.768719:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950940.768755:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944853120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783950940.768905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950940.772393:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853120 00000100:00100000:3.0:1783950940.772407:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853120 00000100:00080000:0.0:1783950940.772766:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950940.772828:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783950940.772847:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944853120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783950940.772885:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950940.772998:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944853120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950940.773007:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1783950940.773094:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28380 x1870607944853120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950940.773117:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944853120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950941.285779:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944853248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783950941.285855:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950941.285933:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853248 00000100:00100000:2.0:1783950941.286757:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853248 00000100:00100000:2.0:1783950941.286832:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783950941.286843:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944853248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783950941.286869:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950941.286926:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944853248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950941.286934:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1783950941.286968:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950941.286999:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e4a80 x1870607944853248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950941.287016:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944853248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783950941.288411:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783950942.305523:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783950943.316525:0:10945:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing yml_node 00000100:00100000:2.0:1783950943.331045:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944853376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950943.331115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950943.332509:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783950943.332522:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944853504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950943.332568:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950943.332618:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853376 00000100:00100000:2.0:1783950943.332626:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853376 00000100:00100000:2.0:1783950943.332680:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783950943.332690:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944853376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950943.332725:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950943.332783:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944853376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950943.332790:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1783950943.332811:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783950943.332910:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e4a80 x1870607944853376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950943.332938:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944853376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950943.334965:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853504 00000100:00100000:3.0:1783950943.334985:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853504 00000100:00100000:3.0:1783950943.335052:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783950943.335063:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944853504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783950943.335102:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783950943.335208:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944853504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.335216:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783950943.335269:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944853504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783950943.335525:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950943.335635:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944853632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783950943.335677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950943.337967:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944853760:0@lo:400:kworker.0 00000100:00100000:2.0:1783950943.338043:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950943.341816:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853632 00000100:00100000:0.0:1783950943.341844:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853632 00000100:00100000:0.0:1783950943.341932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783950943.341943:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944853632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783950943.341972:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950943.348367:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944854016:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348438:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348471:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944854528:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348520:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783950943.348526:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944853888:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348546:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348560:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944854400:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348577:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348591:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944854912:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348608:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348632:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944854272:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348661:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944854784:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348686:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783950943.348691:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944854144:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348735:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944854656:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.348753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950943.348795:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854016 00000100:00100000:3.0:1783950943.348802:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854016 00000100:00100000:3.0:1783950943.348970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853888 00000100:00100000:3.0:1783950943.348973:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853888 00000100:00100000:3.0:1783950943.348988:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854400 00000100:00100000:3.0:1783950943.348990:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854400 00000100:00100000:3.0:1783950943.349005:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854912 00000100:00100000:3.0:1783950943.349007:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854912 00000100:00100000:3.0:1783950943.349020:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854272 00000100:00100000:3.0:1783950943.349022:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854272 00000100:00100000:3.0:1783950943.349035:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854784 00000100:00100000:3.0:1783950943.349038:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854784 00000100:00100000:3.0:1783950943.349054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783950943.349063:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944854016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349117:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944854016:12345-0@lo:400:kworker.0 Request processed in 55us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783950943.349168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783950943.349176:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944853888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349204:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944853888:12345-0@lo:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349211:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783950943.349223:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783950943.349229:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944854400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349253:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944854400:12345-0@lo:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349264:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783950943.349276:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783950943.349282:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944854912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349306:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944854912:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349312:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783950943.349321:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783950943.349327:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944854272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349354:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944854272:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349360:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783950943.349372:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783950943.349379:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944854784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349404:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944854784:12345-0@lo:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349410:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783950943.349428:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854528 00000100:00100000:3.0:1783950943.349432:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854528 00000100:00100000:3.0:1783950943.349457:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854656 00000100:00100000:3.0:1783950943.349460:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854656 00000100:00100000:3.0:1783950943.349476:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783950943.349482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944854528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349509:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944854528:12345-0@lo:400:kworker.0 Request processed in 27us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349514:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783950943.349531:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783950943.349537:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944854656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349563:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944854656:12345-0@lo:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.349570:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783950943.349614:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944853888:0@lo:400:kworker.0 00010000:00080000:3.0:1783950943.349627:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2aa00 x1870607944854400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950943.349637:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944854400:0@lo:400:kworker.0 00010000:00080000:3.0:1783950943.349646:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476cb800 x1870607944854912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950943.349654:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944854912:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349662:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944854016:0@lo:400:kworker.0 00010000:00080000:3.0:1783950943.349670:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d244000 x1870607944854528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950943.349678:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944854528:0@lo:400:kworker.0 00010000:00080000:3.0:1783950943.349711:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476ca680 x1870607944854656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950943.349720:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944854656:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349728:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944854272:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349737:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944854784:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.349763:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944854144 00000100:00100000:0.0:1783950943.350026:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944853632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8083us (14345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950943.350045:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1783950943.350067:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783950943.350072:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950943.350074:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950943.350077:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783950943.350178:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29180 x1870607944853632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950943.350198:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944853632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783950943.350224:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944853760 00000100:00100000:1.0:1783950943.350228:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944853760 00000100:00100000:1.0:1783950943.350262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783950943.350269:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944853760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950943.350310:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944853760:12345-0@lo:400:kworker.0 Request processed in 42us (12268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950943.350317:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783950943.350351:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944853760:0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.351993:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944854144 00000100:00100000:3.0:1783950943.352946:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783950943.352961:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944854144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950943.353052:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944854144:12345-0@lo:400:kworker.0 Request processed in 97us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950943.353060:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783950943.353177:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944854144:0@lo:400:kworker.0 00010000:00010000:1.0:1783950944.352698:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950944.529312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950944.529367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950944.529472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950944.529524:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815552 00000100:00100000:0.0:1783950944.529535:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815552 00000100:00100000:0.0:1783950944.529596:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815680 00000100:00100000:0.0:1783950944.529599:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815680 00000100:00100000:0.0:1783950944.529622:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00100000:0.0:1783950944.529632:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923815552:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950944.529704:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923815552:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950944.529713:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00100000:0.0:1783950944.529729:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 98 00000100:00100000:0.0:1783950944.529736:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923815680:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950944.529761:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923815680:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950944.529767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815424 00000100:00100000:0.0:1783950944.529767:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 98 00000100:00100000:1.0:1783950944.529771:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815424 00000100:00080000:0.0:1783950944.529783:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950944.529786:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783950944.529797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 283 00000100:00100000:1.0:1783950944.529804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923815424:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950944.529829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923815424:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950944.529837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 283 00000100:00100000:0.0:1783950945.378855:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944855040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783950945.379071:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950945.379170:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855040 00000100:00100000:0.0:1783950945.379177:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855040 00000100:00100000:0.0:1783950945.379220:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783950945.379230:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944855040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783950945.379269:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783950945.379333:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944855040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950945.379340:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783950945.379510:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944855040:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1783950945.383015:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:2.0:1783950945.383024:0:8434:0:(genops.c:906:class_export_put()) final put ffff9e037e5db800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:0.0:1783950945.383110:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5db800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-OST0000 00000020:00000080:0.0:1783950945.384012:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e5df800 for lustre-OST0000 00010000:00010000:1.0:1783950945.391951:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783950945.394194:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:3.0:1783950945.394203:0:9517:0:(genops.c:906:class_export_put()) final put ffff9e037fc0d800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:0.0:1783950945.394282:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037fc0d800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-OST0001 00000020:00000080:0.0:1783950945.394344:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037fc0f800 for lustre-OST0001 00000100:00100000:2.0:1783950945.888726:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783950945.888759:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944855168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950945.888834:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950945.892168:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855168 00000100:00100000:0.0:1783950945.892184:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855168 00000100:00100000:0.0:1783950945.892294:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783950945.892308:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944855168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950945.892347:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950945.892440:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944855168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950945.892447:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1783950945.892528:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476caa00 x1870607944855168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950945.892551:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944855168:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783950945.892606:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783950946.400567:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950946.401102:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950946.401124:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783950946.401226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950946.401403:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855296 00000100:00100000:3.0:1783950946.401411:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855296 00000100:00100000:3.0:1783950946.401480:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783950946.401490:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944855296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783950946.401513:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950946.401562:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944855296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950946.401570:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1783950946.401612:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476ca680 x1870607944855296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950946.401630:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944855296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783950946.402996:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1783950946.765851:0:11128:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:1.0:1783950947.424424:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950948.448949:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944855424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950948.449026:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950948.451088:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944855680:0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.451166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950948.452835:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944855808:0@lo:400:kworker.0 00000100:00100000:0.0:1783950948.452919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950948.453186:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855424 00000100:00100000:2.0:1783950948.453194:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855424 00000100:00100000:2.0:1783950948.453240:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783950948.453257:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944855424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783950948.453292:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783950948.453359:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944855424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950948.453366:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783950948.453391:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944855552:0@lo:400:kworker.0 00000100:00100000:2.0:1783950948.453420:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.453808:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944855424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950948.453831:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944855936:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.453859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.453902:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855936 00000100:00100000:3.0:1783950948.453906:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855936 00000100:00100000:3.0:1783950948.453929:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783950948.453936:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.453967:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944855936:12345-0@lo:400:kworker.0 Request processed in 31us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.453974:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783950948.454002:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944855936:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.454009:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944856448:0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.454282:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944856192:0@lo:400:kworker.0 00000100:00100000:0.0:1783950948.454282:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944856320:0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.454312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950948.454312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950948.454337:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944856832:0@lo:400:kworker.0 00000100:00100000:0.0:1783950948.454359:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950948.454382:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950948.454388:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944857216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950948.454412:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.455022:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.455048:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856320 00000100:00100000:3.0:1783950948.455053:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856320 00000100:00100000:3.0:1783950948.455091:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856832 00000100:00100000:3.0:1783950948.455095:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856832 00000100:00100000:3.0:1783950948.455108:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856448 00000100:00100000:3.0:1783950948.455111:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856448 00000100:00100000:3.0:1783950948.455127:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783950948.455134:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944856320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.455193:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944856320:12345-0@lo:400:kworker.0 Request processed in 59us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.455200:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783950948.455213:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783950948.455220:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944856832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.455247:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944856832:12345-0@lo:400:kworker.0 Request processed in 28us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.455252:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783950948.455263:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783950948.455280:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944856448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.455306:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944856448:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.455311:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783950948.455713:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944856704:0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.455753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.455788:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857216 00000100:00100000:3.0:1783950948.455794:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857216 00000100:00100000:3.0:1783950948.455821:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783950948.455826:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944857216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783950948.455849:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950948.455893:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944857216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.455899:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1783950948.455920:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783950948.455924:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950948.455954:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476cb480 x1870607944857216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950948.455974:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944857216:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783950948.455986:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247928700 x1870607944856320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950948.455996:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944856320:0@lo:400:kworker.0 00010000:00080000:3.0:1783950948.456006:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247929500 x1870607944856832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950948.456015:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944856832:0@lo:400:kworker.0 00010000:00080000:3.0:1783950948.456047:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247928380 x1870607944856448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950948.456069:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944856448:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.456076:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944856960:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.456099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.456119:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856960 00000100:00100000:3.0:1783950948.456123:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856960 00000100:00100000:3.0:1783950948.456162:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783950948.456169:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944856960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.456196:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944856960:12345-0@lo:400:kworker.0 Request processed in 28us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.456201:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1783950948.456223:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248164000 x1870607944856960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950948.456231:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944856960:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.456279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855552 00000100:00100000:3.0:1783950948.456283:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855552 00000100:00100000:3.0:1783950948.456309:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783950948.456317:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944855552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.456897:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944855552:12345-0@lo:400:kworker.0 Request processed in 580us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950948.456905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783950948.458576:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855680 00000100:00100000:0.0:1783950948.458589:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855680 00000100:00100000:2.0:1783950948.458593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944855808 00000100:00100000:2.0:1783950948.458597:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944855808 00000100:00100000:2.0:1783950948.458629:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856192 00000100:00100000:0.0:1783950948.458629:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856704 00000100:00100000:0.0:1783950948.458637:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856704 00000100:00100000:2.0:1783950948.458642:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856192 00000100:00100000:0.0:1783950948.458669:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783950948.458678:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783950948.458679:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944855808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950948.458684:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944855680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.458921:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783950948.458931:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00010000:1.0:1783950948.459117:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950948.459163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783950948.459172:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944856704:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783950948.459240:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783950948.462935:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944855680:12345-0@lo:400:kworker.0 Request processed in 4239us (11757us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950948.462952:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783950948.462996:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783950948.463015:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783950948.463030:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944856192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950948.463100:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944856192:12345-0@lo:400:kworker.0 Request processed in 76us (8786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950948.463106:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783950948.463184:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944855680:0@lo:400:kworker.0 00010000:00080000:2.0:1783950948.463204:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247929880 x1870607944856192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950948.463215:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944856192:0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.464968:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944856704:12345-0@lo:400:kworker.0 Request processed in 5786us (9203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950948.464982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1783950948.465039:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247929f80 x1870607944856704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950948.465054:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944856704:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.465309:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944855552:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.465333:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944856064:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.465505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.465542:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944856576:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.465563:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.465587:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856064 00000100:00100000:3.0:1783950948.465593:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856064 00000100:00100000:3.0:1783950948.465631:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944856576 00000100:00100000:3.0:1783950948.465634:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944856576 00000100:00100000:3.0:1783950948.465655:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783950948.465844:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944856064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.465910:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944856064:12345-0@lo:400:kworker.0 Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950948.465951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783950948.465961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944856576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.465993:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944856576:12345-0@lo:400:kworker.0 Request processed in 35us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950948.465999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783950948.466038:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1783950948.466056:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950948.466080:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944856576:0@lo:400:kworker.0 00000100:00100000:3.0:1783950948.466087:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944857088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950948.466115:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950948.466188:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944856064:0@lo:400:kworker.0 00000100:00100000:1.0:1783950948.466486:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857088 00000100:00100000:1.0:1783950948.466492:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857088 00000100:00100000:1.0:1783950948.466529:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783950948.466537:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944857088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783950948.466553:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783950948.466592:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944857088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950948.466599:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1783950948.466802:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e7b80 x1870607944857088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950948.466822:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944857088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950948.469120:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944855808:12345-0@lo:400:kworker.0 Request processed in 10433us (16195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950948.469135:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783950948.469244:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944855808:0@lo:400:kworker.0 00000001:02000400:0.0:1783950949.012397:0:11226:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:0.0:1783950949.474951:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950949.636933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950949.637031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950949.637065:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815936 00000100:00100000:2.0:1783950949.637075:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815936 00000100:00100000:2.0:1783950949.637161:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 105 00000100:00100000:2.0:1783950949.637173:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923815936:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950949.637248:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923815936:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950949.637255:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 105 00000100:00080000:2.0:1783950949.637352:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950949.644104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923815808 00000100:00100000:3.0:1783950949.644120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923815808 00000100:00100000:2.0:1783950949.644440:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 285 00000100:00100000:2.0:1783950949.644452:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2410:x1870607923815808:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950949.644559:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2410:x1870607923815808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (7637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950949.644566:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 285 00000100:00100000:2.0:1783950949.644633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950949.645225:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816064 00000100:00100000:3.0:1783950949.645232:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816064 00000100:00100000:3.0:1783950949.645298:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 106 00000100:00100000:3.0:1783950949.645310:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923816064:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950949.645355:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923816064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 50us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950949.645362:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 106 00000100:00080000:2.0:1783950949.645863:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783950950.497096:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950950.497440:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783950950.497461:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944857344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783950950.497534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950950.498002:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857344 00000100:00100000:2.0:1783950950.498010:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857344 00000100:00100000:2.0:1783950950.498063:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783950950.498073:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944857344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783950950.498111:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783950950.498201:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944857344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950950.498209:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783950950.498514:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944857344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783950951.012817:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944857472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783950951.012919:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950951.013512:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857472 00000100:00100000:1.0:1783950951.013535:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857472 00000100:00100000:1.0:1783950951.013612:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783950951.013623:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944857472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783950951.013653:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783950951.013735:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950951.018092:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944857472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4460us (5161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950951.018122:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1783950951.030607:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476ca300 x1870607944857472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950951.030640:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944857472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950951.521229:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944857600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783950951.521354:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950951.523799:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950951.525515:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857600 00000100:00100000:3.0:1783950951.525530:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857600 00000100:00100000:3.0:1783950951.525619:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783950951.525632:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944857600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783950951.525666:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950951.525769:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944857600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950951.525778:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1783950951.525904:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950951.525948:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476ca300 x1870607944857600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950951.525970:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944857600:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1783950951.954552:0:11324:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:0.0:1783950952.545168:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950953.573502:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950953.580294:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944857856:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580429:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944858368:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580508:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944858880:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580529:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580552:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783950953.580558:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944857728:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580607:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944858240:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580645:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944858752:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580680:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944859264:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580700:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580724:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944857984:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580773:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944858496:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580796:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580812:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944859008:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580844:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580864:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783950953.580870:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944858112:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580891:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580902:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944858624:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580923:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580939:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944859136:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.580958:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.580989:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857856 00000100:00100000:1.0:1783950953.580996:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857856 00000100:00100000:1.0:1783950953.581031:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858368 00000100:00100000:1.0:1783950953.581033:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858368 00000100:00100000:1.0:1783950953.581054:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858880 00000100:00100000:1.0:1783950953.581056:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858880 00000100:00100000:1.0:1783950953.581070:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858496 00000100:00100000:1.0:1783950953.581073:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858496 00000100:00100000:1.0:1783950953.581084:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859008 00000100:00100000:1.0:1783950953.581086:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859008 00000100:00100000:1.0:1783950953.581110:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858112 00000100:00100000:1.0:1783950953.581113:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858112 00000100:00100000:1.0:1783950953.581126:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783950953.581135:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944857856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581225:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944857856:12345-0@lo:400:kworker.0 Request processed in 89us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581242:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783950953.581262:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783950953.581268:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944858368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581297:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944858368:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581303:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783950953.581313:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783950953.581320:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944858880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581344:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944858880:12345-0@lo:400:kworker.0 Request processed in 25us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581350:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783950953.581362:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783950953.581368:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944858496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581397:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944858496:12345-0@lo:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581403:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783950953.581414:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783950953.581420:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944859008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581443:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944859008:12345-0@lo:400:kworker.0 Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581449:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783950953.581460:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783950953.581466:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944858112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581490:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944858112:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581501:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783950953.581528:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857728 00000100:00100000:1.0:1783950953.581538:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857728 00000100:00100000:1.0:1783950953.581563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783950953.581569:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944857728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581598:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944857728:12345-0@lo:400:kworker.0 Request processed in 28us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783950953.581630:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858240 00000100:00100000:1.0:1783950953.581633:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858240 00000100:00100000:1.0:1783950953.581650:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944857984 00000100:00100000:1.0:1783950953.581653:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944857984 00000100:00100000:1.0:1783950953.581663:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783950953.581669:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944858240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581701:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944858240:12345-0@lo:400:kworker.0 Request processed in 32us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581706:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783950953.581717:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783950953.581723:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944857984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581747:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944857984:12345-0@lo:400:kworker.0 Request processed in 24us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581752:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783950953.581769:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858752 00000100:00100000:1.0:1783950953.581773:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858752 00000100:00100000:1.0:1783950953.581791:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859264 00000100:00100000:1.0:1783950953.581794:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859264 00000100:00100000:1.0:1783950953.581806:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944858624 00000100:00100000:1.0:1783950953.581815:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944858624 00000100:00100000:1.0:1783950953.581842:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859136 00000100:00100000:1.0:1783950953.581845:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859136 00000100:00100000:1.0:1783950953.581862:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783950953.581867:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944858752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581901:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944858752:12345-0@lo:400:kworker.0 Request processed in 34us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581908:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783950953.581919:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783950953.581924:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944859264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581951:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944859264:12345-0@lo:400:kworker.0 Request processed in 27us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.581956:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783950953.581966:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783950953.581972:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944858624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.581999:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944858624:12345-0@lo:400:kworker.0 Request processed in 26us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.582005:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783950953.582015:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783950953.582020:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944859136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582045:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944859136:12345-0@lo:400:kworker.0 Request processed in 25us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.582050:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1783950953.582087:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783950953.582092:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783950953.582094:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783950953.582097:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783950953.582137:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944858112:0@lo:400:kworker.0 00010000:00080000:1.0:1783950953.582176:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248164e00 x1870607944858624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950953.582186:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944858624:0@lo:400:kworker.0 00010000:00080000:1.0:1783950953.582197:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248167480 x1870607944859136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950953.582206:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944859136:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582214:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944857984:0@lo:400:kworker.0 00010000:00080000:1.0:1783950953.582224:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248165880 x1870607944858496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950953.582232:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944858496:0@lo:400:kworker.0 00010000:00080000:1.0:1783950953.582242:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248167b80 x1870607944859008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950953.582251:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944859008:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582289:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944857728:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582298:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944858240:0@lo:400:kworker.0 00010000:00080000:1.0:1783950953.582317:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248165f80 x1870607944858752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950953.582326:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944858752:0@lo:400:kworker.0 00010000:00080000:1.0:1783950953.582336:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248167100 x1870607944859264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950953.582358:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944859264:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582373:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944857856:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582382:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944858368:0@lo:400:kworker.0 00000100:00100000:1.0:1783950953.582393:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944858880:0@lo:400:kworker.0 00000100:00100000:3.0:1783950953.582575:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783950953.582585:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944859520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950953.582618:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950953.582646:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859520 00000100:00100000:3.0:1783950953.582650:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859520 00000100:00100000:3.0:1783950953.582675:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783950953.582681:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944859520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783950953.582708:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783950953.582743:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944859520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950953.582750:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783950953.582780:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944859520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950953.582807:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944859392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950953.582844:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950953.582872:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859392 00000100:00100000:3.0:1783950953.582875:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859392 00000100:00100000:3.0:1783950953.582899:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783950953.582905:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944859392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783950953.582926:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950953.582955:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944859392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950953.582962:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1783950953.582984:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476caa00 x1870607944859392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950953.582997:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944859392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950953.583248:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950953.583265:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944859648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950953.583291:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950953.584285:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859648 00000100:00100000:1.0:1783950953.584293:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859648 00000100:00100000:1.0:1783950953.584340:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783950953.584349:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944859648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783950953.584366:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783950953.584419:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944859648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950953.584426:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1783950953.584506:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0ea00 x1870607944859648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950953.584522:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944859648:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1783950953.954227:0:11372:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 09:55:51 EDT 2026 00010000:00010000:1.0:1783950954.592591:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950954.754097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950954.754181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950954.754330:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816320 00000100:00100000:0.0:1783950954.754339:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816320 00000100:00100000:0.0:1783950954.754408:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:0.0:1783950954.754432:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923816320:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950954.754504:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923816320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950954.754512:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:3.0:1783950954.754594:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816192 00000100:00100000:3.0:1783950954.754599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816192 00000100:00100000:3.0:1783950954.754628:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 287 00000100:00100000:3.0:1783950954.754635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923816192:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950954.754665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923816192:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950954.754672:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 287 00000100:00080000:1.0:1783950954.754766:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950954.757755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950954.757869:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816448 00000100:00100000:1.0:1783950954.757880:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816448 00000100:00100000:1.0:1783950954.757964:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:1.0:1783950954.757975:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923816448:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950954.758071:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923816448:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950954.758080:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00080000:2.0:1783950954.758635:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783950955.616411:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950955.617085:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950955.617109:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944859776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783950955.617205:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950955.617275:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859776 00000100:00100000:0.0:1783950955.617281:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859776 00000100:00100000:0.0:1783950955.617342:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783950955.617353:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944859776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783950955.617388:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783950955.617432:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944859776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950955.617440:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783950955.617484:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944859776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783950956.134078:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944859904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783950956.134185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950956.134320:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944859904 00000100:00100000:3.0:1783950956.134329:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944859904 00000100:00080000:2.0:1783950956.134445:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950956.134505:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783950956.134522:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944859904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783950956.134557:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950956.141402:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944859904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6870us (7205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950956.141420:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1783950956.143523:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0a300 x1870607944859904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950956.143550:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944859904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783950956.641083:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950956.647817:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783950956.647849:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944860032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950956.647940:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950956.648007:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860032 00000100:00100000:3.0:1783950956.648014:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860032 00000100:00100000:3.0:1783950956.648072:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783950956.648080:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944860032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783950956.648105:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950956.648171:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944860032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950956.648180:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1783950956.648201:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950956.648231:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024792bb80 x1870607944860032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950956.648249:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944860032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783950957.668294:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950958.690242:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944860160:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783950958.690275:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950958.690329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690379:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944860672:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690402:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690431:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944861184:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690455:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690474:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944861696:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690491:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690509:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783950958.690513:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944860544:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690539:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690554:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944861056:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690568:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690577:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944861568:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690588:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690605:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944860288:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690645:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944860800:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690693:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944861312:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690730:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944861824:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690772:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783950958.690778:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944860416:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690874:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690887:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944860928:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690908:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944861440:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.690919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950958.690941:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861184 00000100:00100000:1.0:1783950958.690946:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861184 00000100:00100000:1.0:1783950958.690980:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861696 00000100:00100000:1.0:1783950958.690981:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861696 00000100:00100000:1.0:1783950958.690989:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861312 00000100:00100000:1.0:1783950958.690991:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861312 00000100:00100000:1.0:1783950958.690998:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861824 00000100:00100000:1.0:1783950958.691000:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861824 00000100:00100000:1.0:1783950958.691010:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783950958.691015:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944861184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691052:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944861184:12345-0@lo:400:kworker.0 Request processed in 37us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691058:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783950958.691069:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783950958.691072:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944861696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691099:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944861696:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691104:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783950958.691114:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783950958.691120:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944861312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691137:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944861312:12345-0@lo:400:kworker.0 Request processed in 19us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691158:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783950958.691167:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783950958.691172:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944861824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691191:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944861824:12345-0@lo:400:kworker.0 Request processed in 20us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691196:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783950958.691213:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860544 00000100:00100000:1.0:1783950958.691216:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860544 00000100:00100000:1.0:1783950958.691230:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860800 00000100:00100000:1.0:1783950958.691231:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860800 00000100:00100000:1.0:1783950958.691239:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783950958.691243:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944860544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691267:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944860544:12345-0@lo:400:kworker.0 Request processed in 22us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783950958.691285:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783950958.691292:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944860800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691319:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944860800:12345-0@lo:400:kworker.0 Request processed in 28us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691333:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783950958.691350:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860672 00000100:00100000:1.0:1783950958.691353:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860672 00000100:00100000:1.0:1783950958.691365:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861056 00000100:00100000:1.0:1783950958.691366:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861056 00000100:00100000:1.0:1783950958.691377:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861568 00000100:00100000:1.0:1783950958.691379:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861568 00000100:00100000:1.0:1783950958.691386:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860416 00000100:00100000:1.0:1783950958.691387:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860416 00000100:00100000:1.0:1783950958.691395:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860928 00000100:00100000:1.0:1783950958.691396:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860928 00000100:00100000:1.0:1783950958.691409:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861440 00000100:00100000:1.0:1783950958.691410:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861440 00000100:00100000:1.0:1783950958.691435:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783950958.691440:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944860672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691464:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944860672:12345-0@lo:400:kworker.0 Request processed in 24us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691469:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783950958.691479:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783950958.691482:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944861056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691496:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944861056:12345-0@lo:400:kworker.0 Request processed in 14us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691500:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783950958.691507:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783950958.691512:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944861568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691530:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944861568:12345-0@lo:400:kworker.0 Request processed in 19us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691533:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783950958.691548:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783950958.691552:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944860416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691576:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944860416:12345-0@lo:400:kworker.0 Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691580:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783950958.691587:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783950958.691591:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944860928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691605:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944860928:12345-0@lo:400:kworker.0 Request processed in 15us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691609:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783950958.691616:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783950958.691621:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944861440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691645:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944861440:12345-0@lo:400:kworker.0 Request processed in 24us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691650:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783950958.691670:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860288 00000100:00100000:1.0:1783950958.691673:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860288 00000100:00100000:1.0:1783950958.691696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783950958.691703:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944860288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691736:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944860288:12345-0@lo:400:kworker.0 Request processed in 33us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950958.691742:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1783950958.691802:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783950958.691806:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783950958.691810:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783950958.691812:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950958.691931:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944860416:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691943:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944860928:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691949:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944861440:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691954:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944860288:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.691959:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944860800:0@lo:400:kworker.0 00010000:00080000:1.0:1783950958.691967:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248165f80 x1870607944861312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950958.691974:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944861312:0@lo:400:kworker.0 00010000:00080000:1.0:1783950958.691980:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248165880 x1870607944861824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950958.691985:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944861824:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.692010:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944860544:0@lo:400:kworker.0 00010000:00080000:1.0:1783950958.692016:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248167800 x1870607944861056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950958.692022:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944861056:0@lo:400:kworker.0 00010000:00080000:1.0:1783950958.692039:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248166a00 x1870607944861568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950958.692044:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944861568:0@lo:400:kworker.0 00000100:00100000:1.0:1783950958.692050:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944860672:0@lo:400:kworker.0 00010000:00080000:1.0:1783950958.692056:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248167100 x1870607944861184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950958.692066:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944861184:0@lo:400:kworker.0 00010000:00080000:1.0:1783950958.692075:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248167b80 x1870607944861696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950958.692081:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944861696:0@lo:400:kworker.0 00000100:00100000:3.0:1783950958.692459:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944861952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950958.692500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950958.692541:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944862080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950958.692569:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950958.692606:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944860160 00000100:00100000:3.0:1783950958.692618:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944860160 00000100:00100000:3.0:1783950958.692720:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944861952 00000100:00100000:3.0:1783950958.692723:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944861952 00000100:00100000:3.0:1783950958.692742:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950958.692749:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944860160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783950958.692774:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950958.692824:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944860160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950958.692831:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783950958.692845:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783950958.692853:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944861952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783950958.692863:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950958.693069:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944861952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950958.693075:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783950958.693094:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862080 00000100:00100000:3.0:1783950958.693098:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862080 00000100:00100000:3.0:1783950958.693125:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783950958.693133:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944862080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783950958.693184:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783950958.693224:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944862080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950958.693231:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1783950958.693261:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0d180 x1870607944860160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950958.693278:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944860160:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783950958.693316:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024792bb80 x1870607944861952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950958.693328:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944861952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950958.693354:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944862080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783950959.715276:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950959.873692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950959.874076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950959.874114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950959.874181:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816576 00000100:00100000:0.0:1783950959.874195:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816576 00000100:00100000:0.0:1783950959.874292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 289 00000100:00100000:0.0:1783950959.874307:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923816576:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950959.874410:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923816576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950959.874420:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 289 00000100:00100000:1.0:1783950959.881227:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816704 00000100:00100000:1.0:1783950959.881248:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816704 00000100:00100000:1.0:1783950959.881373:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816832 00000100:00100000:1.0:1783950959.881378:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816832 00000100:00100000:1.0:1783950959.881415:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:1.0:1783950959.881428:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923816704:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950959.881546:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923816704:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 120us (7870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950959.881555:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:1.0:1783950959.881574:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:1.0:1783950959.881580:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923816832:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950959.881610:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923816832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (7495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950959.881628:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00080000:2.0:1783950959.882548:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783950959.882559:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950960.741088:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944862208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950960.741223:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950960.741331:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862208 00000100:00100000:3.0:1783950960.741341:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862208 00000100:00100000:3.0:1783950960.741406:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783950960.741417:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944862208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783950960.741475:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950960.741535:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944862208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950960.741544:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783950960.741602:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944862208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783950960.752782:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950961.251077:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944862336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783950961.251359:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950961.254542:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862336 00000100:00100000:2.0:1783950961.254564:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862336 00000100:00100000:2.0:1783950961.254996:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783950961.255130:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783950961.255328:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944862336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783950961.255382:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950961.255503:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944862336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 495us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950961.255512:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1783950961.256852:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b09c00 x1870607944862336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950961.256884:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944862336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783950961.760494:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950961.760530:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944862464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950961.760647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950961.760746:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862464 00000100:00100000:3.0:1783950961.760769:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862464 00000100:00100000:3.0:1783950961.760844:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783950961.760853:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944862464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783950961.760886:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950961.760938:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944862464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950961.760947:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1783950961.761106:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950961.761180:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247929c00 x1870607944862464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950961.761204:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944862464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783950961.761775:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950962.784407:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950963.813438:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944862592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950963.813537:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.813683:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950963.813691:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944862720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950963.813720:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.813849:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862592 00000100:00100000:3.0:1783950963.813858:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862592 00000100:00100000:3.0:1783950963.813917:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783950963.813927:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944862592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783950963.813978:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783950963.814035:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944862592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.814044:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783950963.814086:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862720 00000100:00100000:3.0:1783950963.814091:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862720 00000100:00100000:3.0:1783950963.814126:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783950963.814133:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944862720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783950963.814180:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950963.814210:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944862720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.814217:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1783950963.814262:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247928700 x1870607944862720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950963.814284:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944862720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950963.814298:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944862592:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1783950963.814331:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783950963.814535:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950963.814548:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944862848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783950963.814818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950963.814854:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950963.815953:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862848 00000100:00100000:3.0:1783950963.815965:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862848 00000100:00100000:3.0:1783950963.816030:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783950963.816040:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944862848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783950963.816067:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950963.816163:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944862848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.816173:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1783950963.816218:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248160a80 x1870607944862848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950963.816238:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944862848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950963.816543:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944863360:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.816684:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.816720:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944863872:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.816820:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.816847:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783950963.816854:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944862976:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.816883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.816906:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944863488:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.816933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.816954:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944864000:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.816973:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.817001:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944863104:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817024:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.817043:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944863616:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.817079:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944864128:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.817120:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783950963.817126:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944863232:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817172:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.817185:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944863744:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950963.817240:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863360 00000100:00100000:3.0:1783950963.817245:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863360 00000100:00100000:3.0:1783950963.817281:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783950963.817289:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944863360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817345:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944863360:12345-0@lo:400:kworker.0 Request processed in 56us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.817353:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783950963.817376:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863872 00000100:00100000:3.0:1783950963.817380:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863872 00000100:00100000:3.0:1783950963.817408:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863744 00000100:00100000:3.0:1783950963.817411:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863744 00000100:00100000:3.0:1783950963.817433:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783950963.817440:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944863872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817470:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944863872:12345-0@lo:400:kworker.0 Request processed in 31us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.817477:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783950963.817489:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783950963.817495:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944863744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.817524:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944863744:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.817531:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783950963.817550:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944862976 00000100:00100000:3.0:1783950963.817553:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944862976 00000100:00100000:3.0:1783950963.817577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1783950963.818191:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783950963.818197:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783950963.820720:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944862976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.821162:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944862976:12345-0@lo:400:kworker.0 Request processed in 441us (4256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.821172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1783950963.821251:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863488 00000100:00100000:3.0:1783950963.821261:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863488 00000100:00080000:1.0:1783950963.822916:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950963.824206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864000 00000100:00100000:3.0:1783950963.824245:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864000 00000100:00100000:3.0:1783950963.824303:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863104 00000100:00100000:3.0:1783950963.824307:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863104 00000100:00100000:3.0:1783950963.824321:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863616 00000100:00100000:3.0:1783950963.824325:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863616 00000100:00100000:3.0:1783950963.824340:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864128 00000100:00100000:3.0:1783950963.824342:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864128 00000100:00100000:3.0:1783950963.824356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944863232 00000100:00100000:3.0:1783950963.824359:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944863232 00000100:00100000:3.0:1783950963.824382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783950963.824393:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944863488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.824513:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944863488:12345-0@lo:400:kworker.0 Request processed in 122us (7578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.824522:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783950963.824542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783950963.824548:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944864000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.824577:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944864000:12345-0@lo:400:kworker.0 Request processed in 29us (7603us total) trans 0 rc 0/0 00000100:00080000:1.0:1783950963.824691:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783950963.824696:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950963.824731:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783950963.824816:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783950963.824822:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944863104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.824857:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944863104:12345-0@lo:400:kworker.0 Request processed in 35us (7832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.824863:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783950963.824876:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783950963.824883:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944863616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.824912:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944863616:12345-0@lo:400:kworker.0 Request processed in 30us (7849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.824927:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783950963.824939:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783950963.824945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944864128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.824975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944864128:12345-0@lo:400:kworker.0 Request processed in 30us (7873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.824981:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783950963.824992:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783950963.824998:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944863232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.825025:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944863232:12345-0@lo:400:kworker.0 Request processed in 27us (7853us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950963.825031:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783950963.825115:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944862976:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.825133:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944863488:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.825693:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944864000:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.825712:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944863360:0@lo:400:kworker.0 00010000:00080000:3.0:1783950963.825730:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29c00 x1870607944863872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950963.825923:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944863872:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.826011:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944863232:0@lo:400:kworker.0 00010000:00080000:3.0:1783950963.826027:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28a80 x1870607944863744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950963.826037:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944863744:0@lo:400:kworker.0 00000100:00100000:3.0:1783950963.826062:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944863104:0@lo:400:kworker.0 00010000:00080000:3.0:1783950963.826074:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29180 x1870607944863616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950963.826082:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944863616:0@lo:400:kworker.0 00010000:00080000:3.0:1783950963.826094:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28000 x1870607944864128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950963.826102:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944864128:0@lo:400:kworker.0 00010000:00010000:3.0:1783950964.832828:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950965.005931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950965.005995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950965.006027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950965.006059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817216 00000100:00100000:0.0:1783950965.006072:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817216 00000100:00100000:0.0:1783950965.006168:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817088 00000100:00100000:0.0:1783950965.006171:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817088 00000100:00100000:0.0:1783950965.006200:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:0.0:1783950965.006232:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923817216:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950965.006335:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923817216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 124us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950965.006344:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:0.0:1783950965.006364:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:0.0:1783950965.006374:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923817088:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950965.006417:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923817088:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 45us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950965.006424:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00080000:0.0:1783950965.006446:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950965.006451:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783950965.006653:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923816960 00000100:00100000:1.0:1783950965.006659:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923816960 00000100:00100000:1.0:1783950965.006694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 291 00000100:00100000:1.0:1783950965.006702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923816960:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950965.006742:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923816960:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 40us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950965.006748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 291 00000100:00100000:3.0:1783950965.859970:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944864256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950965.860089:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950965.860219:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864256 00000100:00100000:3.0:1783950965.860230:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864256 00000100:00100000:3.0:1783950965.860292:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783950965.860304:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944864256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783950965.860356:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783950965.860415:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944864256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950965.860423:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783950965.860479:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944864256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783950965.860669:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950966.372411:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783950966.372445:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944864384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783950966.372540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950966.372743:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864384 00000100:00100000:0.0:1783950966.372752:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864384 00000100:00100000:0.0:1783950966.372825:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783950966.372857:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944864384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950966.372903:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950966.372958:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944864384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950966.372967:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1783950966.372993:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783950966.373033:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b09c00 x1870607944864384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950966.373059:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944864384:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783950966.880481:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950966.880964:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783950966.880994:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944864512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950966.881101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950966.881217:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864512 00000100:00100000:3.0:1783950966.881226:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864512 00000100:00100000:3.0:1783950966.881318:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783950966.881328:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944864512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783950966.881359:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950966.881424:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944864512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950966.881433:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1783950966.881459:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950966.881497:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc67800 x1870607944864512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950966.881521:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944864512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783950967.906247:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950968.928916:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944864640:0@lo:400:kworker.0 00000100:00100000:3.0:1783950968.929016:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950968.929025:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950968.929077:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944865152:0@lo:400:kworker.0 00000100:00100000:3.0:1783950968.929107:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950968.929287:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944865664:0@lo:400:kworker.0 00000100:00100000:3.0:1783950968.929320:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950968.929339:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944866176:0@lo:400:kworker.0 00000100:00100000:3.0:1783950968.929363:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950968.929376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865152 00000100:00100000:1.0:1783950968.929386:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865152 00000100:00100000:3.0:1783950968.929396:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1783950968.929406:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944864768:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.929459:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944864896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950968.929849:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864640 00000100:00100000:2.0:1783950968.929855:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864640 00000100:00100000:0.0:1783950968.934053:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.934212:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944865408:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.934291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940318:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944865920:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.940411:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940436:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944866432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950968.940466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940514:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1783950968.940522:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944865024:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.940564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940581:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944865536:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.940594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940604:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944866048:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.940616:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940622:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944866560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783950968.940634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950968.940917:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865408 00000100:00100000:0.0:1783950968.940927:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865408 00000100:00100000:0.0:1783950968.940980:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865920 00000100:00100000:0.0:1783950968.940984:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865920 00000100:00100000:0.0:1783950968.941000:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865536 00000100:00100000:0.0:1783950968.941003:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865536 00000100:00100000:0.0:1783950968.941015:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866048 00000100:00100000:0.0:1783950968.941018:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866048 00000100:00100000:0.0:1783950968.941036:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783950968.941047:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944865152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.941807:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944865152:12345-0@lo:400:kworker.0 Request processed in 758us (12694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.941817:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783950968.941841:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783950968.941852:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944865408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.941899:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944865408:12345-0@lo:400:kworker.0 Request processed in 52us (7607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.941906:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783950968.941918:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783950968.941927:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944865920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.941966:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944865920:12345-0@lo:400:kworker.0 Request processed in 42us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.941971:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783950968.941982:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783950968.941992:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944865536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.942043:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944865536:12345-0@lo:400:kworker.0 Request processed in 54us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.942050:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783950968.942061:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783950968.942070:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944866048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.942096:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944866048:12345-0@lo:400:kworker.0 Request processed in 29us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.942115:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783950968.942173:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865024 00000100:00100000:0.0:1783950968.942180:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865024 00000100:00100000:0.0:1783950968.942208:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866560 00000100:00100000:0.0:1783950968.942211:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866560 00000100:00100000:0.0:1783950968.942224:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783950968.942231:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944865024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.942266:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944865024:12345-0@lo:400:kworker.0 Request processed in 36us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.942274:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783950968.942285:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783950968.942293:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944866560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783950968.942331:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783950968.942367:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944866560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.942381:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1783950968.942417:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950968.942422:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950968.942486:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944865024:0@lo:400:kworker.0 00010000:00080000:0.0:1783950968.942505:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc65500 x1870607944865536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950968.942517:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944865536:0@lo:400:kworker.0 00010000:00080000:0.0:1783950968.942528:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28a80 x1870607944866048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950968.942537:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944866048:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.942552:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944866560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783950968.942565:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944865408:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.942575:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944865920:0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.942788:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864896 00000100:00100000:0.0:1783950968.942793:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864896 00000100:00100000:0.0:1783950968.942822:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866432 00000100:00100000:0.0:1783950968.942825:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866432 00000100:00100000:0.0:1783950968.942842:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783950968.942848:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944864896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783950968.942873:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950968.942914:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944864896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.942920:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783950968.942940:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950968.942949:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944866432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783950968.942959:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950968.942986:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944866432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.942992:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783950968.943013:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865664 00000100:00100000:0.0:1783950968.943016:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865664 00000100:00100000:0.0:1783950968.943045:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866176 00000100:00100000:0.0:1783950968.943049:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866176 00000100:00100000:0.0:1783950968.943069:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783950968.943077:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944865664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.943112:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944865664:12345-0@lo:400:kworker.0 Request processed in 36us (13792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.943118:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783950968.943130:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783950968.943138:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944866176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950968.943196:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944866176:12345-0@lo:400:kworker.0 Request processed in 60us (13832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950968.943202:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1783950968.943221:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783950968.943224:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783950968.943243:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b09c00 x1870607944864896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950968.943259:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944864896:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783950968.943271:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248160e00 x1870607944866432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950968.943295:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944866432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950968.944303:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950968.944389:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944865280:0@lo:400:kworker.0 00000100:00100000:3.0:1783950968.944473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950968.944503:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865280 00000100:00100000:1.0:1783950968.944671:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944864768 00000100:00100000:1.0:1783950968.944680:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944864768 00000100:00100000:1.0:1783950968.944745:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783950968.944767:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944864768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950968.944828:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944864768:12345-0@lo:400:kworker.0 Request processed in 64us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950968.944836:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783950968.945063:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865280 00000100:00100000:3.0:1783950968.945170:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783950968.945178:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349452450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944865280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950968.945215:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349452450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944865280:12345-0@lo:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950968.945221:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783950968.946865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783950968.946883:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.946972:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944864640:12345-0@lo:400:kworker.0 Request processed in 95us (17957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950968.946978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783950968.947058:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944865280:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947073:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944865792:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947108:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950968.947137:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944865792 00000100:00100000:2.0:1783950968.947170:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944865792 00000100:00100000:2.0:1783950968.947240:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783950968.947247:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944865792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947280:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944865792:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950968.947286:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1783950968.947303:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950968.947326:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28000 x1870607944865792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950968.947337:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944865792:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947344:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944866304:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947366:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950968.947387:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866304 00000100:00100000:2.0:1783950968.947391:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866304 00000100:00100000:2.0:1783950968.947415:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783950968.947421:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944866304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947453:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944866304:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950968.947470:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783950968.947497:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28380 x1870607944866304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950968.947506:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944866304:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947827:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944864640:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947845:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944865152:0@lo:400:kworker.0 00010000:00080000:2.0:1783950968.947858:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d244000 x1870607944865664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950968.947867:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944865664:0@lo:400:kworker.0 00010000:00080000:2.0:1783950968.947878:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29c00 x1870607944866176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950968.947886:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944866176:0@lo:400:kworker.0 00000100:00100000:2.0:1783950968.947927:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944864768:0@lo:400:kworker.0 00000001:02000400:3.0:1783950969.720805:0:12001:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:56:08 (1783950968) === 00010000:00010000:1.0:1783950969.952510:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950970.121941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.122017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.122171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.122401:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817472 00000100:00100000:2.0:1783950970.122421:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817472 00000100:00100000:2.0:1783950970.122567:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817600 00000100:00100000:2.0:1783950970.122572:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817600 00000100:00100000:2.0:1783950970.123411:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:2.0:1783950970.123428:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923817472:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950970.124041:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923817472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 611us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.124053:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:2.0:1783950970.124101:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1783950970.124110:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923817600:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950970.124172:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923817600:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 63us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.124179:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00080000:2.0:1783950970.124208:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783950970.124214:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783950970.124383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817344 00000100:00100000:3.0:1783950970.124395:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817344 00000100:00100000:3.0:1783950970.124447:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 293 00000100:00100000:3.0:1783950970.124456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923817344:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950970.124491:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2408:x1870607923817344:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 36us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950970.124498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 293 00000100:00100000:0.0:1783950970.199927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.200949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817728 00000100:00100000:2.0:1783950970.200970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817728 00000100:00100000:2.0:1783950970.201122:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 294 00000100:00100000:2.0:1783950970.201136:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:8751:x1870607923817728:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783950970.201205:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950970.201230:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949400/0x7645c8e1169f80e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f4a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.201283:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949400/0x7645c8e1169f80e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4a5 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.201297:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949400/0x7645c8e1169f80e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4a5 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.201310:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949400, rc 0) 00000100:00100000:2.0:1783950970.201401:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8751:x1870607923817728:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 268us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.201409:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 294 00000100:00100000:2.0:1783950970.205485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950970.205792:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817856 00000100:00100000:3.0:1783950970.205806:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817856 00000100:00100000:3.0:1783950970.205888:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 295 00000100:00100000:3.0:1783950970.205901:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8751:x1870607923817856:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783950970.206138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8751:x1870607923817856:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 237us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950970.206196:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 295 00000100:00100000:1.0:1783950970.211289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.211467:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923817984 00000100:00100000:2.0:1783950970.211499:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923817984 00000100:00100000:2.0:1783950970.211581:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 296 00000100:00100000:2.0:1783950970.211602:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8751:x1870607923817984:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783950970.211823:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8751:x1870607923817984:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 224us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.211832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 296 00000100:00100000:0.0:1783950970.216191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.216307:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818112 00000100:00100000:1.0:1783950970.216322:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818112 00000100:00100000:1.0:1783950970.216397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 297 00000100:00100000:1.0:1783950970.216410:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8755:x1870607923818112:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783950970.216880:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8755:x1870607923818112:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 470us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950970.216890:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 297 00000100:00100000:0.0:1783950970.265228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950970.266552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818240 00000100:00100000:3.0:1783950970.266571:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818240 00000100:00100000:3.0:1783950970.266671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 298 00000100:00100000:3.0:1783950970.266913:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8755:x1870607923818240:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783950970.267193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8755:x1870607923818240:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 286us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950970.274855:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 298 00000100:00100000:0.0:1783950970.275796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950970.276061:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818368 00000100:00100000:3.0:1783950970.276074:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818368 00000100:00100000:3.0:1783950970.276136:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 299 00000100:00100000:3.0:1783950970.276173:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8755:x1870607923818368:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783950970.276398:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8755:x1870607923818368:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 228us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950970.276408:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 299 00000100:00100000:0.0:1783950970.281087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950970.281774:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818496 00000100:00100000:3.0:1783950970.281789:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818496 00000100:00100000:2.0:1783950970.284287:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 300 00000100:00100000:2.0:1783950970.284308:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:8751:x1870607923818496:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783950970.284334:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950970.284361:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949e00/0x7645c8e1169f80e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f4d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.284403:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949e00/0x7645c8e1169f80e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4d6 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.284415:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949e00/0x7645c8e1169f80e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4d6 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.284426:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949e00, rc 0) 00000100:00100000:2.0:1783950970.284511:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:8751:x1870607923818496:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 208us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.284519:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 300 00000100:00100000:0.0:1783950970.290083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950970.290810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818624 00000100:00100000:3.0:1783950970.290827:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818624 00000100:00100000:3.0:1783950970.290909:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 301 00000100:00100000:3.0:1783950970.290922:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:8751:x1870607923818624:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783950970.290962:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783950970.290999:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783950970.291004:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783950970.291008:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783950970.291012:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783950970.291014:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1783950970.300669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:8751:x1870607923818624:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 9728us (10579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.300700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 301 00000100:00100000:1.0:1783950970.304716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.304853:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818752 00000100:00100000:2.0:1783950970.304867:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818752 00000100:00100000:2.0:1783950970.304957:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 302 00000100:00100000:2.0:1783950970.304970:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:8751:x1870607923818752:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783950970.304995:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783950970.305019:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f4dd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.305060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.305073:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950970.305085:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948e00, rc 0) 00000100:00100000:2.0:1783950970.305209:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8751:x1870607923818752:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 241us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.305216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 302 00000100:00100000:0.0:1783950970.309271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.309409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923818880 00000100:00100000:2.0:1783950970.309423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923818880 00000100:00100000:2.0:1783950970.309511:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 303 00000100:00100000:2.0:1783950970.309533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8751:x1870607923818880:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783950970.310200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8751:x1870607923818880:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 673us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.310213:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 303 00000100:00100000:0.0:1783950970.312892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.313052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819008 00000100:00100000:1.0:1783950970.313067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819008 00000100:00100000:1.0:1783950970.313183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 304 00000100:00100000:1.0:1783950970.313196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8751:x1870607923819008:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783950970.313402:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8751:x1870607923819008:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 209us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950970.313412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 304 00000100:00100000:1.0:1783950970.321380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950970.322127:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819136 00000100:00100000:0.0:1783950970.322176:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819136 00000100:00100000:0.0:1783950970.322269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 305 00000100:00100000:0.0:1783950970.322284:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8759:x1870607923819136:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783950970.322543:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8759:x1870607923819136:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 262us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950970.322554:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 305 00000100:00100000:0.0:1783950970.328756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.329000:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819264 00000100:00100000:2.0:1783950970.329032:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819264 00000100:00100000:2.0:1783950970.329116:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 306 00000100:00100000:2.0:1783950970.329130:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8759:x1870607923819264:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783950970.329397:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:8759:x1870607923819264:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 269us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.329407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 306 00000100:00100000:2.0:1783950970.343375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.343426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950970.346482:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819392 00000100:00100000:0.0:1783950970.346508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819392 00000100:00100000:0.0:1783950970.346797:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819648 00000100:00100000:0.0:1783950970.346803:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819648 00000100:00100000:0.0:1783950970.346849:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:0.0:1783950970.346858:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1870607923819392:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783950970.346897:0:6527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f7ffa451-5324-4858-a00e-bb5627316d28@192.168.202.33@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:0.0:1783950970.346951:0:6527:0:(genops.c:1406:class_connect()) connect: client f7ffa451-5324-4858-a00e-bb5627316d28, cookie 0x7645c8e1169f80f6 00000004:00100000:0.0:1783950970.347006:0:6527:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783950970.347222:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9e0248056000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950970.347407:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:3.0:1783950970.347414:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870607923819648:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783950970.347445:0:10105:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from f7ffa451-5324-4858-a00e-bb5627316d28@192.168.202.33@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:3.0:1783950970.347489:0:10105:0:(genops.c:1406:class_connect()) connect: client f7ffa451-5324-4858-a00e-bb5627316d28, cookie 0x7645c8e1169f80fd 00000004:00100000:3.0:1783950970.347509:0:10105:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783950970.347730:0:10105:0:(import.c:65:import_set_state_nolock()) ffff9e0381117800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783950970.347827:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2406:x1870607923819648:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 410us (4399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950970.347838:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1783950970.350367:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+6:2406:x1870607923819392:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 3492us (7100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950970.350386:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783950970.353311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950970.353439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819776 00000100:00100000:0.0:1783950970.353460:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819776 00000100:00100000:0.0:1783950970.353580:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783950970.353594:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:0:x1870607923819776:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783950970.353652:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783950970.353791:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:0:x1870607923819776:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 201us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950970.353801:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00080000:2.0:1783950970.355026:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783950970.359230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.359414:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819520 00000100:00100000:1.0:1783950970.359427:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819520 00000100:00100000:1.0:1783950970.359550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783950970.359563:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:0:x1870607923819520:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783950970.359628:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783950970.359774:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:0:x1870607923819520:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 210us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950970.359783:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00080000:2.0:1783950970.360485:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783950970.363443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950970.363636:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923819904 00000100:00100000:0.0:1783950970.363650:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923819904 00000100:00100000:0.0:1783950970.363763:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783950970.363777:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923819904:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783950970.363826:0:11194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783950970.363930:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923819904:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 157us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950970.363939:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:3.0:1783950970.369273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.369457:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820032 00000100:00100000:1.0:1783950970.369471:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820032 00000100:00100000:1.0:1783950970.369558:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1783950970.369570:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923820032:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783950970.369704:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923820032:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 136us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950970.369713:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1783950970.375507:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.375621:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950970.375655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.375797:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820160 00000100:00100000:2.0:1783950970.375810:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820160 00000100:00100000:2.0:1783950970.375863:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820288 00000100:00100000:2.0:1783950970.375867:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820288 00000100:00100000:2.0:1783950970.375891:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:2.0:1783950970.375903:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870607923820160:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783950970.375950:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f7ffa451-5324-4858-a00e-bb5627316d28@192.168.202.33@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1783950970.375990:0:8440:0:(genops.c:1406:class_connect()) connect: client f7ffa451-5324-4858-a00e-bb5627316d28, cookie 0x7645c8e1169f8104 00002000:00100000:2.0:1783950970.376008:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f7ffa451-5324-4858-a00e-bb5627316d28/ffff9e038116b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783950970.376034:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783950970.376175:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783950970.376215:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e0381168000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783950970.376308:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2406:x1870607923820160:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 405us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.376317:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:2.0:1783950970.376336:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:2.0:1783950970.376342:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870607923820288:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783950970.376379:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f7ffa451-5324-4858-a00e-bb5627316d28@192.168.202.33@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1783950970.376397:0:8440:0:(genops.c:1406:class_connect()) connect: client f7ffa451-5324-4858-a00e-bb5627316d28, cookie 0x7645c8e1169f810b 00002000:00100000:2.0:1783950970.376402:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7ffa451-5324-4858-a00e-bb5627316d28/ffff9e038116d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783950970.376417:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783950970.376466:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783950970.376483:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e038116e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783950970.376509:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2406:x1870607923820288:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 165us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.376517:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783950970.381072:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820416 00000100:00100000:0.0:1783950970.381092:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820416 00000100:00100000:0.0:1783950970.381229:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:0.0:1783950970.381246:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923820416:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783950970.381389:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923820416:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 148us (5896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950970.381415:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1783950970.384589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783950970.385686:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820544 00000100:00100000:2.0:1783950970.385704:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820544 00000100:00100000:2.0:1783950970.385794:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:2.0:1783950970.385807:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923820544:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783950970.385985:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783950970.386115:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:8751:x1870607923820544:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 309us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.386123:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:0.0:1783950970.977018:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944866688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783950970.977127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950970.977267:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866688 00000100:00100000:2.0:1783950970.977277:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866688 00010000:00010000:3.0:1783950970.977337:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950970.977346:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783950970.977359:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944866688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783950970.977399:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783950970.977478:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944866688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950970.977486:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783950970.977635:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944866688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783950971.488751:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950971.488792:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944866816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783950971.488892:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950971.488985:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866816 00000100:00100000:0.0:1783950971.488996:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866816 00000100:00100000:0.0:1783950971.489066:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783950971.489096:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944866816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950971.490282:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950971.491580:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944866816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2492us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950971.491597:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1783950971.491644:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950971.499697:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d9c00 x1870607944866816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950971.499735:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944866816:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783950972.001997:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950972.003003:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944866944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783950972.003108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950972.003278:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944866944 00000100:00100000:2.0:1783950972.003289:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944866944 00000100:00100000:2.0:1783950972.003383:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783950972.003395:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944866944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783950972.003427:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950972.003483:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944866944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950972.003492:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1783950972.003598:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950972.003651:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e7b80 x1870607944866944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950972.003681:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944866944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783950973.024272:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950974.049290:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944867200:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049424:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944867712:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049448:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049473:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944868224:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049495:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049524:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944868736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950974.049559:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049592:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783950974.049599:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944867328:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049658:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944867840:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049697:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944868352:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950974.049773:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867200 00000100:00100000:3.0:1783950974.049780:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867200 00000100:00100000:3.0:1783950974.049822:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867712 00000100:00100000:3.0:1783950974.049825:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867712 00000100:00100000:3.0:1783950974.049850:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868224 00000100:00100000:3.0:1783950974.049853:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868224 00000100:00100000:3.0:1783950974.049884:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867840 00000100:00100000:3.0:1783950974.049887:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867840 00000100:00100000:3.0:1783950974.049900:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868352 00000100:00100000:3.0:1783950974.049902:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868352 00000100:00100000:3.0:1783950974.049920:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783950974.049930:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944867200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.049990:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944867200:12345-0@lo:400:kworker.0 Request processed in 60us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950974.049999:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783950974.050016:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783950974.050023:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944867712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050051:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944867712:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950974.050057:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783950974.050068:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783950974.050074:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944868224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050099:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944868224:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950974.050105:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783950974.050115:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783950974.050120:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944867840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050175:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944867840:12345-0@lo:400:kworker.0 Request processed in 54us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950974.050188:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783950974.050199:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783950974.050204:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944868352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050231:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944868352:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950974.050236:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1783950974.050253:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783950974.050258:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783950974.050284:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b08000 x1870607944867840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950974.050298:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944867840:0@lo:400:kworker.0 00010000:00080000:3.0:1783950974.050309:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28000 x1870607944868352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950974.050317:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944868352:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050326:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944867200:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050335:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944867712:0@lo:400:kworker.0 00000100:00100000:3.0:1783950974.050343:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944868224:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051082:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944867072:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051184:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944867584:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051228:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944868096:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051249:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051265:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944868608:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051305:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1783950974.051312:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944867456:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051335:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051354:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944867968:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051392:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944868480:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.051427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950974.051447:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944868992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950974.051468:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950974.051730:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944868864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950974.051841:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783950974.052535:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950974.058009:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867328 00000100:00100000:0.0:1783950974.058024:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867328 00000100:00100000:0.0:1783950974.058076:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867584 00000100:00100000:0.0:1783950974.058080:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867584 00000100:00100000:0.0:1783950974.058094:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868992 00000100:00100000:0.0:1783950974.058097:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868992 00000100:00100000:0.0:1783950974.058115:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783950974.058125:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950974.058250:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944867328:12345-0@lo:400:kworker.0 Request processed in 126us (8618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.058258:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783950974.058274:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783950974.058284:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944867584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950974.058325:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944867584:12345-0@lo:400:kworker.0 Request processed in 44us (7113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.058330:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783950974.058341:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783950974.058349:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944868992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783950974.058375:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783950974.058410:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944868992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (6941us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.058416:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783950974.058435:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867072 00000100:00100000:0.0:1783950974.058438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867072 00000100:00100000:0.0:1783950974.058464:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1783950974.058472:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944867072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950974.058519:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944867072:12345-0@lo:400:kworker.0 Request processed in 48us (7391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.058526:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1783950974.058569:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867456 00000100:00100000:0.0:1783950974.058573:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867456 00000100:00100000:0.0:1783950974.058603:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783950974.058611:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944867456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950974.058651:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944867456:12345-0@lo:400:kworker.0 Request processed in 33us (7305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.058665:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783950974.058690:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868736 00000100:00100000:0.0:1783950974.058694:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868736 00000100:00100000:0.0:1783950974.058721:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868864 00000100:00100000:0.0:1783950974.058724:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868864 00000100:00100000:0.0:1783950974.058929:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783950974.058943:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944868736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783950974.058966:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950974.059003:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944868736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (9443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.059009:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783950974.059021:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783950974.059029:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944868864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783950974.059038:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950974.059070:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944868864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (7229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950974.059077:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1783950974.059125:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e7b80 x1870607944868864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950974.059171:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944868864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950974.059338:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868096 00000100:00100000:2.0:1783950974.059343:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868096 00000100:00100000:2.0:1783950974.059370:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868608 00000100:00100000:2.0:1783950974.059373:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868608 00000100:00100000:2.0:1783950974.059385:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944867968 00000100:00100000:2.0:1783950974.059387:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944867968 00000100:00100000:2.0:1783950974.059402:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944868480 00000100:00100000:2.0:1783950974.059404:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944868480 00000100:00100000:2.0:1783950974.059415:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783950974.059421:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944868096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.059456:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944868096:12345-0@lo:400:kworker.0 Request processed in 35us (8205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950974.059462:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783950974.059473:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783950974.059479:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944868608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.061048:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944868608:12345-0@lo:400:kworker.0 Request processed in 1562us (9756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950974.061061:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783950974.061091:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783950974.061101:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944867968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.061135:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944867968:12345-0@lo:400:kworker.0 Request processed in 36us (9758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950974.061163:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783950974.061175:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783950974.061191:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.061223:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944868480:12345-0@lo:400:kworker.0 Request processed in 33us (9796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950974.061228:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783950974.061293:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944867456:0@lo:400:kworker.0 00010000:00080000:2.0:1783950974.061309:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b09c00 x1870607944867968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950974.061319:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944867968:0@lo:400:kworker.0 00010000:00080000:2.0:1783950974.061330:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2b800 x1870607944868480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950974.061337:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944868480:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.061357:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944868992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950974.061370:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944867072:0@lo:400:kworker.0 00000100:00100000:2.0:1783950974.061380:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944867584:0@lo:400:kworker.0 00010000:00080000:2.0:1783950974.061390:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29c00 x1870607944868096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950974.061398:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944868096:0@lo:400:kworker.0 00010000:00080000:2.0:1783950974.061408:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2bb80 x1870607944868608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950974.061416:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944868608:0@lo:400:kworker.0 00000100:00080000:3.0:1783950974.062499:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783950974.062507:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783950974.062556:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944867328:0@lo:400:kworker.0 00010000:00080000:3.0:1783950974.062575:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247928380 x1870607944868736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950974.062616:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944868736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783950975.072816:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950975.764871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950975.764909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950975.764948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950975.764984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950975.765004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950975.765022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950975.765043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950975.765130:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820672 00000100:00100000:0.0:1783950975.765169:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820672 00000100:00100000:0.0:1783950975.765253:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 308 00000100:00100000:0.0:1783950975.765266:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923820672:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950975.765342:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923820672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950975.765365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 308 00000100:00100000:0.0:1783950975.765403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820800 00000100:00100000:0.0:1783950975.765408:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820800 00000100:00100000:0.0:1783950975.765437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821056 00000100:00100000:0.0:1783950975.765440:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821056 00000100:00100000:0.0:1783950975.765455:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923820928 00000100:00100000:0.0:1783950975.765458:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923820928 00000100:00100000:0.0:1783950975.765470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821184 00000100:00100000:0.0:1783950975.765473:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821184 00000100:00100000:0.0:1783950975.765487:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:0.0:1783950975.765494:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923820800:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950975.765527:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923820800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 33us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950975.765533:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:0.0:1783950975.765546:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:0.0:1783950975.765554:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:2407:x1870607923821056:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950975.765576:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:2407:x1870607923821056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950975.765582:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:0.0:1783950975.765593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 147 00000100:00100000:0.0:1783950975.765600:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923820928:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950975.765624:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923820928:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950975.765645:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 147 00000100:00100000:0.0:1783950975.765657:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00100000:0.0:1783950975.765673:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:2408:x1870607923821184:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950975.765698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:2408:x1870607923821184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950975.765704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00080000:3.0:1783950975.767064:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783950975.767073:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783950975.769876:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821312 00000100:00100000:2.0:1783950975.769911:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821312 00000100:00100000:2.0:1783950975.769980:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821440 00000100:00100000:2.0:1783950975.769983:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821440 00000100:00100000:2.0:1783950975.770010:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:2.0:1783950975.770020:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2407:x1870607923821312:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950975.770102:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2407:x1870607923821312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (5117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950975.770109:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:2.0:1783950975.770288:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:2.0:1783950975.770296:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2408:x1870607923821440:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950975.770323:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2408:x1870607923821440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950975.770329:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00080000:3.0:1783950975.771036:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783950975.771042:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783950976.098403:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950976.098424:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944869120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783950976.098488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950976.098557:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869120 00000100:00100000:1.0:1783950976.098572:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869120 00000100:00100000:1.0:1783950976.098617:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783950976.098641:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944869120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783950976.098679:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783950976.098726:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944869120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950976.098733:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783950976.098791:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944869120:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1783950976.103757:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000001:00100000:3.0:1783950976.103943:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000001:00100000:2.0:1783950976.104032:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000001:00100000:1.0:1783950976.107167:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000001:02000400:3.0:1783950976.153573:0:12194:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1783950976.609321:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783950976.618451:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944869248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950976.618552:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950976.618901:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869248 00000100:00100000:0.0:1783950976.618911:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869248 00000100:00100000:0.0:1783950976.619043:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1783950976.619062:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783950976.619067:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944869248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950976.619103:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950976.619194:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944869248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950976.619202:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1783950976.619827:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29180 x1870607944869248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950976.619849:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944869248:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783950977.121649:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950977.122568:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944869376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783950977.122850:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950977.122926:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869376 00000100:00100000:1.0:1783950977.122933:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869376 00000100:00100000:1.0:1783950977.122991:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783950977.123001:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944869376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783950977.123024:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783950977.123071:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944869376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950977.123079:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1783950977.123105:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783950977.123178:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28a80 x1870607944869376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950977.123198:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944869376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783950978.156325:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950979.168305:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950979.168882:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944869504:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169482:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944870016:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169538:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944870528:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169562:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169578:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944871040:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169609:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169631:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783950979.169637:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944869632:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169677:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944870144:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169711:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944870656:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169748:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944871168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783950979.169787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169822:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944869760:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169845:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169865:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944870272:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169885:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169901:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944870784:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169938:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783950979.169944:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944869888:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.169979:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.169989:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944870400:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.170008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.170023:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944870912:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.170041:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950979.170073:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870016 00000100:00100000:3.0:1783950979.170081:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870016 00000100:00100000:3.0:1783950979.170118:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869760 00000100:00100000:3.0:1783950979.170121:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869760 00000100:00100000:3.0:1783950979.170137:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783950979.170166:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944870016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.170221:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944870016:12345-0@lo:400:kworker.0 Request processed in 56us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950979.170228:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783950979.170246:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783950979.170252:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944869760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171025:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869632 00000100:00100000:0.0:1783950979.171033:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869632 00000100:00100000:0.0:1783950979.171078:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870144 00000100:00100000:0.0:1783950979.171081:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870144 00000100:00100000:0.0:1783950979.171108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870656 00000100:00100000:0.0:1783950979.171111:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870656 00000100:00100000:0.0:1783950979.171127:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870272 00000100:00100000:0.0:1783950979.171131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870272 00000100:00100000:0.0:1783950979.171164:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870784 00000100:00100000:0.0:1783950979.171167:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870784 00000100:00100000:0.0:1783950979.171193:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869888 00000100:00100000:0.0:1783950979.171196:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869888 00000100:00100000:0.0:1783950979.171213:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783950979.171220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944869632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171283:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944869632:12345-0@lo:400:kworker.0 Request processed in 50us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950979.171290:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783950979.171314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783950979.171322:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944870144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171355:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944870144:12345-0@lo:400:kworker.0 Request processed in 35us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950979.171360:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783950979.171371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783950979.171379:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944870656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171406:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944870656:12345-0@lo:400:kworker.0 Request processed in 29us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950979.171411:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783950979.171421:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783950979.171428:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944870272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171689:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944870272:12345-0@lo:400:kworker.0 Request processed in 262us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950979.171695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783950979.171707:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783950979.171715:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944870784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171745:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944870784:12345-0@lo:400:kworker.0 Request processed in 33us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950979.171749:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783950979.171759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783950979.171767:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944869888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950979.171793:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944869888:12345-0@lo:400:kworker.0 Request processed in 27us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950979.171798:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1783950979.171828:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950979.171832:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950979.171868:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944869888:0@lo:400:kworker.0 00010000:00080000:0.0:1783950979.171883:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d8a80 x1870607944870272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950979.171893:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944870272:0@lo:400:kworker.0 00010000:00080000:0.0:1783950979.171905:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b08000 x1870607944870784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950979.171913:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944870784:0@lo:400:kworker.0 00000100:00100000:3.0:1783950979.172086:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944869760:12345-0@lo:400:kworker.0 Request processed in 1833us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950979.172093:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783950979.172121:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871168 00000100:00100000:3.0:1783950979.172125:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871168 00000100:00100000:3.0:1783950979.172169:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783950979.172176:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037eb68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944871168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783950979.172202:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950979.172233:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037eb68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944871168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950979.172239:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1783950979.172383:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783950979.172405:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944869760:0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.172575:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870528 00000100:00100000:2.0:1783950979.172579:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870528 00000100:00100000:2.0:1783950979.172676:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871040 00000100:00100000:2.0:1783950979.172680:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871040 00000100:00100000:2.0:1783950979.172693:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870400 00000100:00100000:2.0:1783950979.172695:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870400 00000100:00100000:2.0:1783950979.172710:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944870912 00000100:00100000:2.0:1783950979.172713:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944870912 00000100:00100000:2.0:1783950979.172727:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783950979.172733:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944870528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.172780:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944870528:12345-0@lo:400:kworker.0 Request processed in 47us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950979.172787:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783950979.172802:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783950979.172808:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944871040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.172835:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944871040:12345-0@lo:400:kworker.0 Request processed in 27us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950979.172840:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783950979.172850:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783950979.172858:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944870400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.172885:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944870400:12345-0@lo:400:kworker.0 Request processed in 29us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950979.172890:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783950979.172900:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783950979.172906:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944870912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.172931:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944870912:12345-0@lo:400:kworker.0 Request processed in 26us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950979.172936:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783950979.173076:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944871424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950979.173112:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950979.173169:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783950979.173177:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944871296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950979.173202:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950979.173225:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871296 00000100:00100000:2.0:1783950979.173229:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871296 00000100:00100000:2.0:1783950979.173256:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783950979.173261:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944871296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950979.173524:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950979.173563:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944871296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 302us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950979.173570:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1783950979.173608:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e1500 x1870607944871296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950979.173626:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944871296:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783950979.173647:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783950979.173651:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783950979.173659:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871424 00000100:00100000:2.0:1783950979.173662:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871424 00000100:00100000:2.0:1783950979.173682:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783950979.173688:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944871424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783950979.173712:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783950979.173749:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944871424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950979.173755:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783950979.173780:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944871424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950979.173834:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944869632:0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.173845:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944870144:0@lo:400:kworker.0 00000100:00100000:2.0:1783950979.173858:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944870656:0@lo:400:kworker.0 00010000:00080000:2.0:1783950979.173870:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248165880 x1870607944871168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950979.173891:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944871168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783950979.173907:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944870016:0@lo:400:kworker.0 00010000:00080000:2.0:1783950979.173917:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b09c00 x1870607944870528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950979.173924:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944870528:0@lo:400:kworker.0 00010000:00080000:2.0:1783950979.173932:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03489c5500 x1870607944871040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950979.173939:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944871040:0@lo:400:kworker.0 00010000:00080000:0.0:1783950979.175094:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469da300 x1870607944870400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950979.175109:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944870400:0@lo:400:kworker.0 00010000:00080000:0.0:1783950979.175119:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03489c5f80 x1870607944870912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783950995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950979.175128:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944870912:0@lo:400:kworker.0 00000100:00100000:1.0:1783950979.180137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944869504 00000100:00100000:1.0:1783950979.180357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944869504 00000100:00100000:1.0:1783950979.180615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783950979.180627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944869504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950979.180724:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944869504:12345-0@lo:400:kworker.0 Request processed in 99us (11768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950979.180731:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783950979.180815:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944869504:0@lo:400:kworker.0 00010000:00010000:0.0:1783950980.195903:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950980.868890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950980.868942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950980.868981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950980.869011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950980.869031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950980.869131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950980.869195:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821824 00000100:00100000:1.0:1783950980.869210:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821824 00000100:00100000:1.0:1783950980.869291:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822080 00000100:00100000:1.0:1783950980.869294:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822080 00000100:00100000:1.0:1783950980.869332:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821696 00000100:00100000:1.0:1783950980.869335:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821696 00000100:00100000:1.0:1783950980.869348:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821952 00000100:00100000:1.0:1783950980.869350:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821952 00000100:00100000:1.0:1783950980.869369:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 155 00000100:00100000:1.0:1783950980.869379:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923821824:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950980.869486:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923821824:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 108us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950980.869494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 155 00000100:00100000:1.0:1783950980.869514:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 156 00000100:00100000:1.0:1783950980.869535:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822080:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950980.869561:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822080:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950980.869567:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 156 00000100:00100000:1.0:1783950980.869588:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 157 00000100:00100000:1.0:1783950980.869595:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923821696:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950980.869620:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923821696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950980.869626:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 157 00000100:00100000:1.0:1783950980.869637:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 158 00000100:00100000:1.0:1783950980.869643:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923821952:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950980.869667:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923821952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950980.869673:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 158 00000100:00100000:1.0:1783950980.869707:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822336 00000100:00100000:1.0:1783950980.869711:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822336 00000100:00100000:1.0:1783950980.869742:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:1.0:1783950980.869748:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822336:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950980.869774:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822336:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950980.869787:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00080000:1.0:1783950980.869813:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783950980.869818:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783950980.869820:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783950980.870255:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923821568 00000100:00100000:0.0:1783950980.870262:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923821568 00000100:00100000:0.0:1783950980.870305:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 310 00000100:00100000:0.0:1783950980.870314:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923821568:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950980.870363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923821568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 51us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950980.870379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 310 00000100:00100000:3.0:1783950980.872451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950980.872656:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822208 00000100:00100000:0.0:1783950980.872668:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822208 00000100:00100000:0.0:1783950980.872755:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:0.0:1783950980.872785:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822208:12345-192.168.202.33@tcp:400:kworker.0 00000100:00080000:3.0:1783950980.872797:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783950980.872876:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 111us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950980.872885:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:1.0:1783950981.216735:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783950981.216767:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944871552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783950981.216860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783950981.216934:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950981.217063:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871552 00000100:00100000:2.0:1783950981.217073:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871552 00000100:00100000:2.0:1783950981.217135:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783950981.217175:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944871552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783950981.217223:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783950981.217286:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944871552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950981.217294:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783950981.217537:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944871552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783950981.737469:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944871680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950981.737544:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950981.738198:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871680 00000100:00100000:0.0:1783950981.738206:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871680 00000100:00100000:0.0:1783950981.738275:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783950981.738299:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944871680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950981.738331:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950981.738380:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944871680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950981.738388:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1783950981.738453:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950981.738486:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28e00 x1870607944871680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950981.738517:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944871680:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783950982.241876:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950982.250032:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783950982.257001:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944871808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950982.257101:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950982.257340:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871808 00000100:00100000:0.0:1783950982.257349:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871808 00000100:00100000:0.0:1783950982.257439:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783950982.257468:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944871808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783950982.257503:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950982.257559:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944871808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950982.257681:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1783950982.257920:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950982.257957:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28700 x1870607944871808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783950998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950982.257982:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944871808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783950983.264913:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783950984.184766:0:12510:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783950984.185082:0:12510:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783950984.293036:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944872064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950984.293137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950984.293272:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872064 00000100:00100000:2.0:1783950984.293283:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872064 00000100:00100000:2.0:1783950984.293356:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783950984.293367:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944872064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950984.293428:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950984.293480:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944872064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950984.293489:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1783950984.293514:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783950984.293643:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476e0a80 x1870607944872064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950984.293664:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944872064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950984.293869:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944871936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950984.293907:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950984.294402:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944872192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950984.294437:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950984.294473:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872192 00000100:00100000:0.0:1783950984.294478:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872192 00000100:00100000:0.0:1783950984.294514:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783950984.294522:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944872192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783950984.294537:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950984.294582:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944872192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950984.294588:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1783950984.294607:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783950984.294625:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2a300 x1870607944872192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950984.294638:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944872192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783950984.295837:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944871936 00000100:00100000:2.0:1783950984.295847:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944871936 00000100:00100000:2.0:1783950984.295899:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783950984.295908:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944871936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783950984.295951:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783950984.296027:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944871936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950984.296035:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783950984.296614:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944872448:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.296668:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950984.296700:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944872960:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.296741:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950984.296762:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944873472:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.296784:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950984.296830:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944871936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950984.296853:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783950984.296859:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944872320:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.296890:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950984.296919:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944872832:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.296941:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950984.296960:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944873344:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.296982:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950984.297010:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872448 00000100:00100000:3.0:1783950984.297016:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872448 00000100:00100000:3.0:1783950984.297046:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872960 00000100:00100000:3.0:1783950984.297048:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872960 00000100:00100000:3.0:1783950984.297072:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873472 00000100:00100000:3.0:1783950984.297076:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873472 00000100:00100000:3.0:1783950984.297107:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872832 00000100:00100000:3.0:1783950984.297111:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872832 00000100:00100000:3.0:1783950984.297123:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873344 00000100:00100000:3.0:1783950984.297125:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873344 00000100:00100000:3.0:1783950984.297169:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783950984.297178:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944872448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.297228:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944872448:12345-0@lo:400:kworker.0 Request processed in 50us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.297236:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783950984.297253:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783950984.297267:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944872960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.297299:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944872960:12345-0@lo:400:kworker.0 Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.297305:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783950984.297318:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783950984.297324:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944873472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.297349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944873472:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.297355:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783950984.297368:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783950984.297374:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944872832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950984.297869:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944872704:0@lo:400:kworker.0 00000100:00100000:2.0:1783950984.297928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950984.297955:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944873216:0@lo:400:kworker.0 00000100:00100000:2.0:1783950984.297982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950984.298008:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783950984.298015:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944872576:0@lo:400:kworker.0 00000100:00100000:2.0:1783950984.298040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950984.298052:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944873088:0@lo:400:kworker.0 00000100:00100000:2.0:1783950984.298073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950984.298104:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872704 00000100:00100000:2.0:1783950984.298111:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872704 00000100:00100000:2.0:1783950984.298167:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783950984.298175:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944872704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950984.298223:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944872704:12345-0@lo:400:kworker.0 Request processed in 49us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950984.298230:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783950984.298282:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944872704:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298532:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944872832:12345-0@lo:400:kworker.0 Request processed in 1158us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.298540:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783950984.298569:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872576 00000100:00100000:3.0:1783950984.298573:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872576 00000100:00100000:3.0:1783950984.298592:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783950984.298599:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944873344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298633:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944873344:12345-0@lo:400:kworker.0 Request processed in 34us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.298639:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783950984.298652:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783950984.298658:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944872576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298694:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944872576:12345-0@lo:400:kworker.0 Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.298718:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783950984.298750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944872320 00000100:00100000:3.0:1783950984.298755:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944872320 00000100:00100000:3.0:1783950984.298790:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783950984.298797:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944872320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298832:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944872320:12345-0@lo:400:kworker.0 Request processed in 36us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950984.298838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1783950984.298861:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873216 00000100:00100000:1.0:1783950984.298865:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873216 00000100:00100000:3.0:1783950984.298886:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944872576:0@lo:400:kworker.0 00000100:00080000:3.0:1783950984.298905:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783950984.298910:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783950984.298913:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783950984.298928:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944872320:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298939:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944872832:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298950:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944873344:0@lo:400:kworker.0 00000100:00100000:3.0:1783950984.298963:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944872448:0@lo:400:kworker.0 00010000:00080000:3.0:1783950984.298977:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248017800 x1870607944872960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950984.298988:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944872960:0@lo:400:kworker.0 00010000:00080000:3.0:1783950984.298998:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248017480 x1870607944873472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950984.299006:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944873472:0@lo:400:kworker.0 00000100:00100000:1.0:1783950984.299035:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873088 00000100:00100000:1.0:1783950984.299038:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873088 00000100:00100000:1.0:1783950984.299076:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783950984.299083:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944873216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783950984.299092:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783950984.299133:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944873216:12345-0@lo:400:kworker.0 Request processed in 50us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950984.299158:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783950984.299173:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783950984.299179:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944873088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950984.299212:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944873088:12345-0@lo:400:kworker.0 Request processed in 33us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950984.299218:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1783950984.299695:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248014a80 x1870607944873088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950984.299706:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944873088:0@lo:400:kworker.0 00010000:00080000:3.0:1783950984.299718:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248014e00 x1870607944873216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950984.299725:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944873216:0@lo:400:kworker.0 00010000:00010000:3.0:1783950984.302192:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950985.313495:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950985.985726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950985.986269:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822592 00000100:00100000:3.0:1783950985.986275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950985.986290:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822592 00000100:00100000:3.0:1783950985.986303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950985.986334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950985.986358:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822848 00000100:00100000:3.0:1783950985.986362:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950985.986364:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822848 00000100:00100000:0.0:1783950985.986395:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822720 00000100:00100000:0.0:1783950985.986399:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822720 00000100:00100000:3.0:1783950985.986403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950985.986420:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822976 00000100:00100000:0.0:1783950985.986424:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822976 00000100:00100000:0.0:1783950985.986460:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:3.0:1783950985.986470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950985.986477:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923822592:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950985.986503:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 166 00000100:00100000:3.0:1783950985.986516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822848:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950985.986569:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923822592:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950985.986570:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 55us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950985.986581:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 166 00000100:00100000:0.0:1783950985.986593:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:3.0:1783950985.986614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:3.0:1783950985.986623:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923822720:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950985.986635:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 168 00000100:00100000:0.0:1783950985.986645:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822976:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950985.986652:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923822720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950985.986670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:0.0:1783950985.986680:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923822976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950985.986688:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 168 00000100:00100000:3.0:1783950985.986697:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823104 00000100:00100000:3.0:1783950985.986702:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823104 00000100:00080000:0.0:1783950985.986713:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783950985.986718:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950985.986729:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923822464 00000100:00100000:0.0:1783950985.986734:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923822464 00000100:00100000:3.0:1783950985.986756:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823232 00000100:00100000:3.0:1783950985.986761:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823232 00000100:00100000:0.0:1783950985.986770:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 312 00000100:00100000:3.0:1783950985.986791:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:0.0:1783950985.986793:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923822464:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950985.986803:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923823104:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950985.986823:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923822464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950985.986831:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 312 00000100:00100000:3.0:1783950985.986862:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923823104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 61us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950985.986870:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:3.0:1783950985.986885:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:3.0:1783950985.986894:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923823232:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950985.986924:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923823232:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950985.986932:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00080000:0.0:1783950985.986983:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783950985.986987:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950986.336836:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783950986.336860:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944873600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950986.336930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950986.337037:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873600 00000100:00100000:1.0:1783950986.337047:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873600 00000100:00100000:1.0:1783950986.337098:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783950986.337109:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944873600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783950986.337202:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783950986.337250:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944873600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950986.337258:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:1.0:1783950986.337353:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950986.337917:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944873600:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1783950986.396239:0:12609:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783950986.396499:0:12609:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783950986.848559:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783950986.848586:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944873728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783950986.848650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950986.848791:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873728 00000100:00100000:0.0:1783950986.848800:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873728 00000100:00100000:0.0:1783950986.848892:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783950986.848901:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944873728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950986.848937:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950986.848981:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944873728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950986.848989:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1783950986.849038:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2a300 x1870607944873728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950986.849055:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944873728:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783950986.856489:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783950987.361361:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944873856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783950987.361490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950987.361559:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873856 00000100:00100000:0.0:1783950987.361572:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873856 00000100:00100000:0.0:1783950987.361667:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783950987.361680:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944873856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783950987.361706:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950987.361784:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944873856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950987.361791:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1783950987.361854:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950987.362012:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2a300 x1870607944873856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950987.362031:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944873856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783950987.365498:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783950988.379733:0:12707:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783950988.380466:0:12707:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783950988.384525:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950989.410293:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783950989.410317:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944873984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950989.410403:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950989.410464:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944873984 00000100:00100000:0.0:1783950989.410470:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944873984 00000100:00100000:0.0:1783950989.410771:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783950989.410797:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944873984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783950989.410831:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950989.410880:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944873984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.410888:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1783950989.410930:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29880 x1870607944873984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950989.410948:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944873984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783950989.412084:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783950989.414230:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783950989.417036:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944874112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950989.419006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.419116:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783950989.419130:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944874240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950989.419371:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874112 00000100:00100000:0.0:1783950989.419381:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874112 00000100:00100000:0.0:1783950989.419451:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783950989.419462:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944874112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783950989.419521:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783950989.420891:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944874368:0@lo:400:kworker.0 00000100:00100000:3.0:1783950989.421018:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944874752:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.421547:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944874112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2084us (4346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.421559:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783950989.422319:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944874496:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.422826:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950989.422870:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944875008:0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.422887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950989.422902:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950989.422933:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944875520:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.422955:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.422964:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944874112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783950989.422979:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783950989.422989:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944874880:0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.422991:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944874624:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.423023:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.423044:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874240 00000100:00100000:2.0:1783950989.423052:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874240 00000100:00100000:0.0:1783950989.423052:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944875392:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.423077:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.423128:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783950989.423138:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944874240:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950989.423323:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783950989.423383:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783950989.423427:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944875264:0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.423440:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944874240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 301us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950989.423449:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783950989.423462:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.423477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.423498:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944875136:0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.423532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950989.423638:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944875648:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.423648:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874496 00000100:00100000:0.0:1783950989.423653:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874496 00000100:00100000:2.0:1783950989.423665:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783950989.423695:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a29880 x1870607944874240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950989.423697:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875008 00000100:00100000:0.0:1783950989.423703:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875008 00000100:00100000:2.0:1783950989.423718:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944874240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783950989.423723:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875520 00000100:00100000:0.0:1783950989.423727:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875520 00000100:00100000:0.0:1783950989.423747:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874880 00000100:00100000:0.0:1783950989.423750:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874880 00000100:00100000:0.0:1783950989.423780:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875392 00000100:00100000:0.0:1783950989.423783:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875392 00000100:00100000:0.0:1783950989.423798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874624 00000100:00100000:0.0:1783950989.423801:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874624 00000100:00100000:0.0:1783950989.423818:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783950989.423825:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944874496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.423877:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944874496:12345-0@lo:400:kworker.0 Request processed in 52us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.423885:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783950989.423903:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783950989.423914:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944875008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.423917:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944874496:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.423955:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944875008:12345-0@lo:400:kworker.0 Request processed in 44us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.423963:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00080000:2.0:1783950989.423975:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abc700 x1870607944875008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950989.423980:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783950989.423991:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944875520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.424008:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944875008:0@lo:400:kworker.0 00010000:00080000:2.0:1783950989.424025:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476c8380 x1870607944875520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950989.424034:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944875520:0@lo:400:kworker.0 00000100:00100000:3.0:1783950989.424098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783950989.424105:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944874880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.424228:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944875520:12345-0@lo:400:kworker.0 Request processed in 239us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.424236:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783950989.424251:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783950989.424260:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944875392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.424301:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944875392:12345-0@lo:400:kworker.0 Request processed in 44us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.424308:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783950989.424323:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1783950989.424326:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783950989.424332:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783950989.424335:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944874624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783950989.424336:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783950989.424363:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944875392:0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.424381:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874752 00000100:00100000:2.0:1783950989.424385:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874752 00000100:00100000:2.0:1783950989.424423:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783950989.424429:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944874752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.424468:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944874752:12345-0@lo:400:kworker.0 Request processed in 39us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950989.424474:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783950989.424604:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944874624:12345-0@lo:400:kworker.0 Request processed in 273us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950989.424611:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783950989.425098:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944874624:0@lo:400:kworker.0 00000100:00100000:3.0:1783950989.426740:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944874880:12345-0@lo:400:kworker.0 Request processed in 2627us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950989.426754:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783950989.426782:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875264 00000100:00100000:2.0:1783950989.426793:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875264 00000100:00100000:3.0:1783950989.426806:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875136 00000100:00100000:3.0:1783950989.426812:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875136 00000100:00100000:2.0:1783950989.426868:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875648 00000100:00100000:2.0:1783950989.426872:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875648 00000100:00100000:2.0:1783950989.426892:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783950989.426903:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944875264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.426958:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944875264:12345-0@lo:400:kworker.0 Request processed in 58us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950989.426976:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783950989.426990:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783950989.426997:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944875648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.427039:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944875648:12345-0@lo:400:kworker.0 Request processed in 43us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950989.427045:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783950989.427167:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950989.427249:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944874368 00000100:00100000:1.0:1783950989.427254:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944874368 00000100:00100000:1.0:1783950989.427283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1783950989.427290:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944874368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783950989.427327:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944874368:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950989.427334:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1783950989.427392:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944874368:0@lo:400:kworker.0 00000100:00080000:2.0:1783950989.432735:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783950989.432829:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476ca300 x1870607944875648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950989.432851:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944875648:0@lo:400:kworker.0 00000100:00100000:2.0:1783950989.432901:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944874880:0@lo:400:kworker.0 00000100:00100000:0.0:1783950989.436313:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944874752:0@lo:400:kworker.0 00010000:00080000:0.0:1783950989.436337:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abf800 x1870607944875264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950989.436359:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944875264:0@lo:400:kworker.0 00000100:00100000:3.0:1783950989.439597:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783950989.439612:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944875136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950989.439705:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944875136:12345-0@lo:400:kworker.0 Request processed in 97us (16172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950989.439713:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1783950989.439772:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abe300 x1870607944875136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950989.439788:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944875136:0@lo:400:kworker.0 00000020:00000004:3.0:1783950990.361985:0:12804:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950990.362202:0:12804:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783950990.438096:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950991.106466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950991.106633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950991.106837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950991.106867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950991.106910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823360 00000100:00100000:3.0:1783950991.106921:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823360 00000100:00100000:3.0:1783950991.106976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 314 00000100:00100000:3.0:1783950991.106985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923823360:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950991.107057:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923823360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950991.107064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 314 00000100:00100000:2.0:1783950991.108261:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823488 00000100:00100000:2.0:1783950991.108272:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823488 00000100:00100000:2.0:1783950991.108327:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823744 00000100:00100000:2.0:1783950991.108343:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823744 00000100:00100000:2.0:1783950991.108372:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 175 00000100:00100000:2.0:1783950991.108381:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923823488:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950991.108438:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923823488:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 58us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950991.108446:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 175 00000100:00100000:2.0:1783950991.108472:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 176 00000100:00100000:2.0:1783950991.108480:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923823744:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783950991.108523:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923823744:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 44us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950991.108530:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 176 00000100:00080000:2.0:1783950991.108548:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783950991.110467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950991.110602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823616 00000100:00100000:3.0:1783950991.110613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823616 00000100:00100000:3.0:1783950991.110664:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923823872 00000100:00100000:3.0:1783950991.110667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923823872 00000100:00100000:3.0:1783950991.110691:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 177 00000100:00100000:3.0:1783950991.110701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923823616:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950991.110769:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923823616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950991.110777:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 177 00000100:00100000:3.0:1783950991.110794:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 178 00000100:00100000:3.0:1783950991.110801:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923823872:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950991.110822:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923823872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950991.110828:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 178 00000100:00100000:0.0:1783950991.112079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950991.112111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950991.112184:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824000 00000100:00100000:3.0:1783950991.112191:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824000 00000100:00100000:3.0:1783950991.112237:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824128 00000100:00100000:3.0:1783950991.112240:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824128 00000100:00100000:3.0:1783950991.112262:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:3.0:1783950991.112270:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2406:x1870607923824000:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:3.0:1783950991.112293:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f8104 00000100:00080000:3.0:1783950991.112301:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e0381168000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783950991.112402:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783950991.112556:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+2:2406:x1870607923824000:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 285us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950991.112562:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:3.0:1783950991.112575:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:3.0:1783950991.112706:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2406:x1870607923824128:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:3.0:1783950991.112718:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f810b 00000100:00080000:3.0:1783950991.112724:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e038116e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783950991.112747:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783950991.112817:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7ffa451-5324-4858-a00e-bb5627316d28+2:2406:x1870607923824128:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 112us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950991.112824:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00010000:00010000:3.0:1783950991.112846:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950991.114298:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783950991.114318:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783950991.114324:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783950991.114328:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783950991.459897:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944875776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783950991.459975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950991.467250:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875776 00000100:00100000:2.0:1783950991.467266:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875776 00000100:00100000:2.0:1783950991.467322:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783950991.467334:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944875776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783950991.467374:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783950991.467462:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944875776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (7487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950991.467470:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783950991.467819:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944875776:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783950991.469897:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950991.973809:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944875904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783950991.973918:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950991.974226:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944875904 00000100:00100000:0.0:1783950991.974236:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944875904 00000100:00100000:0.0:1783950991.974333:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783950991.974368:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944875904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950991.974412:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950991.974715:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944875904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 370us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950991.974723:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1783950991.975223:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783950991.975267:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28e00 x1870607944875904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950991.975302:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944875904:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1783950992.106309:0:12901:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783950992.106681:0:12901:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783950992.484733:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783950992.484767:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944876032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783950992.484860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950992.484949:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876032 00000100:00100000:1.0:1783950992.484959:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876032 00000100:00100000:1.0:1783950992.485170:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783950992.485183:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944876032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783950992.485214:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783950992.485281:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944876032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950992.485289:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1783950992.485315:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783950992.485430:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248166d80 x1870607944876032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783950992.485457:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944876032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783950992.487136:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950993.504492:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950994.528710:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944876416:0@lo:400:kworker.0 00000100:00100000:1.0:1783950994.528782:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950994.528837:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944876928:0@lo:400:kworker.0 00000100:00100000:1.0:1783950994.528863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950994.528885:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944877440:0@lo:400:kworker.0 00000100:00100000:1.0:1783950994.528904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950994.528926:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783950994.528932:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944876544:0@lo:400:kworker.0 00000100:00100000:1.0:1783950994.528952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950994.528968:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944877056:0@lo:400:kworker.0 00000100:00100000:1.0:1783950994.528990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950994.529009:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944877568:0@lo:400:kworker.0 00000100:00100000:1.0:1783950994.529031:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950994.529272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876928 00000100:00100000:3.0:1783950994.529279:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876928 00000100:00100000:3.0:1783950994.529322:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877440 00000100:00100000:3.0:1783950994.529324:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877440 00000100:00100000:3.0:1783950994.529359:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876544 00000100:00100000:3.0:1783950994.529361:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876544 00000100:00100000:3.0:1783950994.529371:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783950994.529377:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944876928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.529422:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944876928:12345-0@lo:400:kworker.0 Request processed in 44us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.529439:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783950994.529465:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783950994.529473:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944877440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.529504:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944877440:12345-0@lo:400:kworker.0 Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.529510:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783950994.529522:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783950994.529528:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944876544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.529565:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944876544:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.529571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783950994.529591:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877056 00000100:00100000:3.0:1783950994.529594:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877056 00000100:00100000:3.0:1783950994.529619:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877568 00000100:00100000:3.0:1783950994.529622:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877568 00000100:00100000:3.0:1783950994.529640:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783950994.529647:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944877056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.529679:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944877056:12345-0@lo:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.529685:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783950994.529696:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783950994.529702:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944877568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.529728:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944877568:12345-0@lo:400:kworker.0 Request processed in 28us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.529732:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783950994.529773:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944876544:0@lo:400:kworker.0 00010000:00080000:3.0:1783950994.529782:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248166d80 x1870607944877056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950994.529789:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944877056:0@lo:400:kworker.0 00010000:00080000:3.0:1783950994.529794:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e7f7100 x1870607944877568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950994.529798:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944877568:0@lo:400:kworker.0 00010000:00080000:3.0:1783950994.529803:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0ca80 x1870607944876928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950994.529807:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944876928:0@lo:400:kworker.0 00010000:00080000:3.0:1783950994.529812:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e7f7480 x1870607944877440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950994.529817:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944877440:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.529998:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944876288:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530030:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530047:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944876800:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530084:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944877312:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530097:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530107:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783950994.530110:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944876160:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530166:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944876672:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530190:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530201:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944877184:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530214:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530223:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944877696:0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530235:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950994.530250:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877184 00000100:00100000:0.0:1783950994.530252:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877184 00000100:00100000:0.0:1783950994.530270:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877696 00000100:00100000:0.0:1783950994.530271:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877696 00000100:00100000:0.0:1783950994.530280:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783950994.530283:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944877184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530306:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944877184:12345-0@lo:400:kworker.0 Request processed in 22us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950994.530309:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783950994.530316:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783950994.530321:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944877696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530391:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944877696:12345-0@lo:400:kworker.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950994.530395:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783950994.530418:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876288 00000100:00100000:0.0:1783950994.530421:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876288 00000100:00100000:0.0:1783950994.530438:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876800 00000100:00100000:0.0:1783950994.530440:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876800 00000100:00100000:0.0:1783950994.530451:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877312 00000100:00100000:0.0:1783950994.530463:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877312 00000100:00100000:0.0:1783950994.530481:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783950994.530488:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944876288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950994.530519:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944876288:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950994.530525:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783950994.530536:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783950994.530544:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944876800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.530997:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783950994.531004:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944877312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783950994.531092:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783950994.531101:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944877824:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783950994.531301:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783950994.531306:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783950994.531307:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783950994.531309:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783950994.531321:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876160 00000100:00100000:1.0:1783950994.531324:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876160 00000100:00100000:1.0:1783950994.531404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1783950994.531409:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944876160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.534793:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944877312:12345-0@lo:400:kworker.0 Request processed in 3779us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.534807:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00010000:00010000:3.0:1783950994.534889:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950994.534911:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876416 00000100:00100000:3.0:1783950994.534920:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876416 00000100:00100000:3.0:1783950994.534953:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944876672 00000100:00100000:3.0:1783950994.534957:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944876672 00000100:00100000:3.0:1783950994.534971:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783950994.534997:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944876416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.535069:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944876416:12345-0@lo:400:kworker.0 Request processed in 73us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.535075:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783950994.535090:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783950994.535097:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944876672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.535129:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944876672:12345-0@lo:400:kworker.0 Request processed in 33us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.535135:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783950994.535196:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944876416:0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.535281:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783950994.535290:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944877952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783950994.535521:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950994.535600:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944878080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950994.535626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950994.535650:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878080 00000100:00100000:3.0:1783950994.535654:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878080 00000100:00100000:3.0:1783950994.535675:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783950994.535681:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944878080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783950994.535710:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783950994.535746:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944878080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950994.535753:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783950994.535783:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944878080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950994.535837:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944876672:0@lo:400:kworker.0 00010000:00080000:3.0:1783950994.535865:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e7f5500 x1870607944877184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950994.535874:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944877184:0@lo:400:kworker.0 00010000:00080000:3.0:1783950994.535885:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e7f4000 x1870607944877696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950994.535893:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944877696:0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.535905:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944876288:0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.535917:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944877312:0@lo:400:kworker.0 00000100:00100000:2.0:1783950994.536289:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950994.536425:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877952 00000100:00100000:2.0:1783950994.536430:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877952 00000100:00100000:2.0:1783950994.536495:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944877824 00000100:00100000:2.0:1783950994.536499:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944877824 00000100:00100000:2.0:1783950994.536515:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783950994.536521:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944877952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950994.536546:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950994.536596:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944877952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950994.536603:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783950994.536617:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783950994.536623:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944877824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783950994.536633:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950994.536662:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944877824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950994.536669:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1783950994.536696:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476c8380 x1870607944877952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950994.536711:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944877952:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1783950994.536737:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476ca300 x1870607944877824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950994.536749:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944877824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783950994.537211:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944876160:12345-0@lo:400:kworker.0 Request processed in 5799us (7079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950994.537221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1783950994.537346:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944876800:12345-0@lo:400:kworker.0 Request processed in 6802us (7273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950994.537355:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783950994.537700:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944876160:0@lo:400:kworker.0 00000100:00100000:3.0:1783950994.537715:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944876800:0@lo:400:kworker.0 00000001:02000400:1.0:1783950995.389913:0:13047:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783950995.554192:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783950996.237040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950996.237096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783950996.237203:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824256 00000100:00100000:3.0:1783950996.237217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824256 00000100:00100000:3.0:1783950996.237289:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 316 00000100:00100000:3.0:1783950996.237301:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923824256:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783950996.237398:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923824256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950996.237408:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 316 00000100:00100000:0.0:1783950996.237565:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824384 00000100:00100000:0.0:1783950996.237570:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824384 00000100:00100000:0.0:1783950996.237619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 185 00000100:00100000:0.0:1783950996.237643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923824384:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950996.237678:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923824384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 53us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950996.237685:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 185 00000100:00080000:1.0:1783950996.238320:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783950996.250405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950996.251045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950996.251098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783950996.251133:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824640 00000100:00100000:1.0:1783950996.251134:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824512 00000100:00100000:0.0:1783950996.251165:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824640 00000100:00100000:1.0:1783950996.251173:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824512 00000100:00100000:1.0:1783950996.251526:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824768 00000100:00100000:1.0:1783950996.251531:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824768 00000100:00100000:0.0:1783950996.251806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 186 00000100:00100000:0.0:1783950996.251821:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923824512:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950996.252130:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923824512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 313us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950996.252161:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 186 00000100:00100000:0.0:1783950996.252352:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 187 00000100:00100000:0.0:1783950996.252367:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923824640:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783950996.252606:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923824640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 244us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950996.252613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 187 00000100:00080000:0.0:1783950996.252785:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950996.252791:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783950996.261861:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 188 00000100:00100000:1.0:1783950996.261881:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923824768:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783950996.262015:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923824768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 139us (10915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950996.262024:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 188 00000100:00100000:0.0:1783950996.583610:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944878208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783950996.583711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950996.585579:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878208 00000100:00100000:2.0:1783950996.585600:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878208 00000100:00100000:2.0:1783950996.585678:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783950996.585690:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944878208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783950996.585754:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783950996.585859:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944878208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950996.585867:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783950996.585936:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944878208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783950996.588673:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783950997.090379:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783950997.090414:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944878336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783950997.090526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950997.090622:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878336 00000100:00100000:0.0:1783950997.090633:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878336 00000100:00100000:0.0:1783950997.090723:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783950997.090753:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944878336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783950997.090806:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950997.090866:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944878336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950997.090876:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1783950997.090930:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247929500 x1870607944878336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950997.090970:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944878336:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783950997.092218:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1783950997.094184:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000020:00000080:2.0:1783950997.094197:0:8434:0:(genops.c:906:class_export_put()) final put ffff9e038116b000/f7ffa451-5324-4858-a00e-bb5627316d28 00000020:00000080:2.0:1783950997.094239:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e038116b000/f7ffa451-5324-4858-a00e-bb5627316d28 for lustre-OST0000 00000020:00000080:2.0:1783950997.094689:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0381168000 for lustre-OST0000 00000001:00100000:2.0:1783950997.099093:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000020:00000080:2.0:1783950997.099104:0:9517:0:(genops.c:906:class_export_put()) final put ffff9e038116d800/f7ffa451-5324-4858-a00e-bb5627316d28 00000020:00000080:1.0:1783950997.099609:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e038116d800/f7ffa451-5324-4858-a00e-bb5627316d28 for lustre-OST0001 00000020:00000080:1.0:1783950997.099738:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e038116e000 for lustre-OST0001 00010000:00010000:0.0:1783950997.600484:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950997.600627:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783950997.600656:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944878464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783950997.600762:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950997.603988:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878464 00000100:00100000:0.0:1783950997.604006:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878464 00000100:00080000:1.0:1783950997.604173:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783950997.604273:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783950997.604291:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944878464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783950997.604346:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783950997.604476:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944878464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950997.604485:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1783950997.604597:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e7f5880 x1870607944878464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783950997.604618:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944878464:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1783950998.528062:0:13194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5db8eef0 20000000:00000080:3.0:1783950998.528079:0:13194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0246662000 uarg=0000000000000000 20000000:01000000:3.0:1783950998.528123:0:13194:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783950998.528129:0:13194:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783950998.528133:0:13194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783950998.528819:0:13195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1783950998.528975:0:13194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783950998.536013:0:13194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783950998.536047:0:13194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536070:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536081:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536089:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536116:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536125:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536134:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536582:0:13194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536633:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536649:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 12 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.536666:0:13194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878592:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783950998.536777:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536787:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 23 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.536797:0:13194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878720:0@lo:104: 00000100:00100000:2.0:1783950998.536840:0:13194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950998.536885:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536902:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 23 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.536925:0:13194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878848:0@lo:104: 00000100:00100000:2.0:1783950998.536951:0:13194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950998.536978:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.536987:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 23 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.536997:0:13194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878976:0@lo:104: 00000100:00100000:2.0:1783950998.537017:0:13194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950998.537049:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878720 00000100:00100000:2.0:1783950998.537056:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878720 00000100:00100000:2.0:1783950998.537116:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878848 00000100:00100000:2.0:1783950998.537119:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878848 00000100:00100000:2.0:1783950998.537131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944878976 00000100:00100000:2.0:1783950998.537134:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944878976 00000100:00100000:2.0:1783950998.537191:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950998.537201:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:13194:x1870607944878720:12345-0@lo:104: 00010000:00010000:2.0:1783950998.537215:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537264:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783950998.537270:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:13194:x1870607944878720:12345-0@lo:104: Request processed in 71us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950998.537290:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783950998.537316:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783950998.537322:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:13194:x1870607944878848:12345-0@lo:104: 00010000:00010000:2.0:1783950998.537331:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537364:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783950998.537369:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:13194:x1870607944878848:12345-0@lo:104: Request processed in 48us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950998.537375:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783950998.537388:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783950998.537394:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:13194:x1870607944878976:12345-0@lo:104: 00010000:00010000:2.0:1783950998.537402:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537629:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783950998.537635:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:13194:x1870607944878976:12345-0@lo:104: Request processed in 241us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950998.537642:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1783950998.537663:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783950998.537669:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537678:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783950998.537683:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537692:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950998.537712:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950998.537718:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783950998.537752:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537758:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950998.537776:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537783:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f80d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537797:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783950998.537801:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537807:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5dc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783950998.537810:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537817:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783950998.537823:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950998.537829:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783950998.537851:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537858:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950998.537873:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537879:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f80c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80cc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537889:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783950998.537892:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537898:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783950998.537901:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.537907:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.538120:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950998.539560:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944879104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783950998.539626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783950998.539835:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944879104 00000100:00100000:1.0:1783950998.539855:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944879104 00010000:00010000:1.0:1783950998.539889:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 24 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950998.539927:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783950998.539935:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944879104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783950998.539949:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950998.539955:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 24 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.539966:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 24 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.539986:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950998.540023:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944879104:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950998.540030:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783950998.541859:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944879104:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1783950998.542070:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783950998.542077:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783950998.542117:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.542123:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783950998.542136:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.542179:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66a00/0x7645c8e1169f80b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.542195:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950998.542197:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783950998.542199:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950998.542223:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944879360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783950998.542288:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950998.542326:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783950998.542332:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944879232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783950998.542350:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783950998.542390:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.542402:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 23 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.542412:0:13194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944879488:0@lo:104: 00000100:00100000:2.0:1783950998.542452:0:13194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950998.542481:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944879488 00000100:00100000:2.0:1783950998.542487:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944879488 00000100:00100000:2.0:1783950998.542527:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783950998.542535:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:13194:x1870607944879488:12345-0@lo:104: 00010000:00010000:2.0:1783950998.542545:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.542585:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783950998.542596:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:13194:x1870607944879488:12345-0@lo:104: Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950998.542602:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1783950998.542637:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.542646:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.542657:0:13194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944879616:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783950998.542703:0:13194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342985540 going to sleep for 11 seconds 00010000:00010000:2.0:1783950998.542719:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3800/0x7645c8e1169f80da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f80d3 expref: 23 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.542728:0:13194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878720:0@lo:104: 00000100:00100000:2.0:1783950998.542738:0:13194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878848:0@lo:104: 00000100:00100000:2.0:1783950998.542745:0:13194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878976:0@lo:104: 00000100:00100000:2.0:1783950998.542751:0:13194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944879488:0@lo:104: 00000100:00100000:3.0:1783950998.542980:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944879360 00000100:00100000:3.0:1783950998.542985:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944879360 00010000:00010000:3.0:1783950998.543008:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 23 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950998.543068:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944879232 00000100:00100000:3.0:1783950998.543072:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944879232 00010000:00010000:3.0:1783950998.543084:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 24 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783950998.543101:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783950998.543107:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944879360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783950998.543116:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950998.543122:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950998.543131:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950998.543167:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f80be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f80b7 expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950998.543180:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950998.543220:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+23:3653:x1870607944879360:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950998.543227:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783950998.543244:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783950998.543250:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+22:3653:x1870607944879232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783950998.543257:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783950998.543273:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 22 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950998.543281:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 22 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950998.543292:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f80cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f80c5 expref: 22 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783950998.543299:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783950998.543320:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+21:3653:x1870607944879232:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950998.543325:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1783950998.543576:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783950998.543583:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.543592:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783950998.543596:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.543605:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783950998.543612:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783950998.543629:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783950998.543653:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.543659:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783950998.543677:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.543684:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f80a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f80b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.543697:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950998.543699:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950998.543701:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950998.543795:0:13194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944878592:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783950998.543828:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944879744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783950998.543858:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950998.543894:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944879744 00000100:00100000:2.0:1783950998.543898:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944879744 00010000:00010000:2.0:1783950998.543913:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 21 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.543932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783950998.543946:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+21:3654:x1870607944879744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783950998.543956:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783950998.543960:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 21 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.543969:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 21 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.543980:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f80b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f80a9 expref: 21 pid: 6520 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.543990:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783950998.544018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+20:3654:x1870607944879744:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950998.544024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783950998.544047:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944879744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783950998.544071:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944879232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783950998.544077:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944879360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783950998.544502:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783950998.546622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950998.547004:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923824896 00000100:00100000:1.0:1783950998.547016:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923824896 00010000:00010000:1.0:1783950998.547054:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 13 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950998.547094:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:1.0:1783950998.547103:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923824896:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783950998.547119:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950998.547125:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 13 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.547137:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 13 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.547182:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948e00/0x7645c8e1169f80ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4dd expref: 13 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.547208:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950998.547273:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:2407:x1870607923824896:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 170us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950998.547280:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:2.0:1783950998.550492:0:13194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1870607944879616:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783950998.550547:0:13194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783950998.554018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783950998.554104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825024 00000100:00100000:1.0:1783950998.554115:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825024 00010000:00010000:1.0:1783950998.554194:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783950998.554231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1783950998.554241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:2408:x1870607923825024:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783950998.554268:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783950998.554275:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554287:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554306:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948a00/0x7645c8e1169f80a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f49e expref: 12 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554322:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554331:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554347:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554367:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554374:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554381:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554387:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783950998.554392:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554399:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554410:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783950998.554434:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783950998.554485:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:2408:x1870607923825024:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 245us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783950998.554493:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00010000:00010000:2.0:1783950998.554731:0:13194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.554753:0:13194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.554760:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8112 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783950998.633563:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783950999.651195:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783950999.652626:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783950999.652648:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944879872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783950999.652709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783950999.652772:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944879872 00000100:00100000:3.0:1783950999.652778:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944879872 00000100:00100000:3.0:1783950999.652819:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783950999.652826:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944879872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783950999.652859:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783950999.652897:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944879872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783950999.652911:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783950999.652950:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944879872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783950999.653573:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944880000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950999.653610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950999.653664:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880000 00000100:00100000:2.0:1783950999.653669:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880000 00000100:00100000:2.0:1783950999.653703:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783950999.653709:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944880000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783950999.653733:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950999.653764:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944880000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950999.653770:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783950999.653785:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783950999.653805:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abd180 x1870607944880000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950999.653820:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944880000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783950999.656481:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944880128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783950999.656546:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783950999.656738:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880128 00000100:00100000:2.0:1783950999.656745:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880128 00000100:00100000:2.0:1783950999.656789:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783950999.656805:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944880128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783950999.656827:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783950999.656865:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944880128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783950999.656872:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1783950999.656892:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783950999.656918:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0d500 x1870607944880128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783950999.656937:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944880128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783950999.657526:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944880512:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.657561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.657585:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944881024:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.657603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.657621:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783950999.657626:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944880640:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.657662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.657684:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944881152:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.657704:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.657733:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880512 00000100:00100000:0.0:1783950999.657737:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880512 00000100:00100000:0.0:1783950999.657779:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783950999.657786:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944880512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.657836:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944880512:12345-0@lo:400:kworker.0 Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.657844:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783950999.657864:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881024 00000100:00100000:0.0:1783950999.657867:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881024 00000100:00100000:0.0:1783950999.657895:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881152 00000100:00100000:0.0:1783950999.657898:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881152 00000100:00100000:0.0:1783950999.657920:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783950999.657926:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944881024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.657956:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944881024:12345-0@lo:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.657962:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783950999.657972:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783950999.657980:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944881152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658007:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944881152:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658012:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1783950999.658044:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b08380 x1870607944881152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950999.658055:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944881152:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658067:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944880512:0@lo:400:kworker.0 00010000:00080000:0.0:1783950999.658075:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b08700 x1870607944881024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950999.658083:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944881024:0@lo:400:kworker.0 00000100:00080000:0.0:1783950999.658101:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783950999.658128:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944880384:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658196:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.658215:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944880896:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.658249:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944881408:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.658287:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783950999.658293:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944880256:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658318:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.658341:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944880768:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658361:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.658376:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944881280:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658395:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783950999.658431:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880384 00000100:00100000:0.0:1783950999.658434:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880384 00000100:00100000:0.0:1783950999.658455:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880896 00000100:00100000:0.0:1783950999.658458:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880896 00000100:00100000:0.0:1783950999.658474:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881408 00000100:00100000:0.0:1783950999.658477:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881408 00000100:00100000:0.0:1783950999.658489:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880768 00000100:00100000:0.0:1783950999.658491:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880768 00000100:00100000:0.0:1783950999.658501:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881280 00000100:00100000:0.0:1783950999.658503:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881280 00000100:00100000:0.0:1783950999.658517:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783950999.658524:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944880384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658564:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944880384:12345-0@lo:400:kworker.0 Request processed in 40us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658581:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783950999.658594:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783950999.658603:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944880896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658632:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944880896:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658638:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783950999.658649:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783950999.658657:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944881408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658684:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944881408:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658689:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783950999.658701:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783950999.658709:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944880768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658735:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944880768:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658741:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783950999.658752:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783950999.658760:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658785:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944881280:12345-0@lo:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658791:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783950999.658815:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880256 00000100:00100000:0.0:1783950999.658818:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880256 00000100:00100000:0.0:1783950999.658845:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783950999.658853:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:3655:x1870607944880256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658889:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:3655:x1870607944880256:12345-0@lo:400:kworker.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.658894:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:0.0:1783950999.658923:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783950999.658927:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783950999.658945:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944880256:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658955:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944880768:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658963:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944881280:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.658971:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944880384:0@lo:400:kworker.0 00010000:00080000:0.0:1783950999.658980:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0b100 x1870607944880896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950999.658989:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944880896:0@lo:400:kworker.0 00010000:00080000:0.0:1783950999.658997:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b08000 x1870607944881408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783950999.659005:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944881408:0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.659029:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944880640 00000100:00100000:0.0:1783950999.659032:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944880640 00000100:00100000:0.0:1783950999.659059:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783950999.659066:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944880640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783950999.659099:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944880640:12345-0@lo:400:kworker.0 Request processed in 35us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783950999.659106:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783950999.659127:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944880640:0@lo:400:kworker.0 00000100:00100000:0.0:1783951000.130906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951000.131205:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825152 00000100:00100000:1.0:1783951000.131216:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825152 00000100:00100000:1.0:1783951000.131272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 318 00000100:00100000:1.0:1783951000.131283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:6181:x1870607923825152:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951000.131300:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951000.131328:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f50e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951000.131373:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951000.131387:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951000.131396:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951000.131587:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923825152:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 305us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951000.131595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 318 00000100:00100000:0.0:1783951000.135379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951000.135487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825280 00000100:00100000:3.0:1783951000.135499:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825280 00000100:00100000:3.0:1783951000.135559:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 319 00000100:00100000:3.0:1783951000.135571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923825280:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.135726:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923825280:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 156us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.135733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 319 00000100:00100000:1.0:1783951000.138927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951000.140120:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825408 00000100:00100000:0.0:1783951000.140136:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825408 00000100:00100000:0.0:1783951000.140236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 320 00000100:00100000:0.0:1783951000.140248:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923825408:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951000.140415:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923825408:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 159us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951000.140423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 320 00000100:00100000:0.0:1783951000.162952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951000.163717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825536 00000100:00100000:3.0:1783951000.163730:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825536 00000100:00100000:3.0:1783951000.163786:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 321 00000100:00100000:3.0:1783951000.163796:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923825536:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951000.163814:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951000.163831:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f515 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.163859:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.163872:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.163882:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3e00, rc 0) 00000100:00100000:3.0:1783951000.163936:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923825536:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 141us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.163960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 321 00000100:00100000:2.0:1783951000.169905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951000.172934:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825664 00000100:00100000:3.0:1783951000.172948:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825664 00000100:00100000:3.0:1783951000.173052:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 322 00000100:00100000:3.0:1783951000.173063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923825664:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.173239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923825664:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 176us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.173261:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 322 00000100:00100000:1.0:1783951000.177789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951000.177848:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825792 00000100:00100000:2.0:1783951000.177858:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825792 00000100:00100000:2.0:1783951000.177916:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 323 00000100:00100000:2.0:1783951000.177927:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923825792:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.178068:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923825792:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 142us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.178076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 323 10000000:01000000:3.0:1783951000.549498:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951000.549506:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0241aa4000 from 7 10000000:01000000:3.0:1783951000.549511:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951000.549558:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.549570:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.549582:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951000.549608:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.549675:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.549720:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951000.549753:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881536 00000100:00100000:3.0:1783951000.549759:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881536 00000100:00100000:3.0:1783951000.556472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783951000.556494:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944881536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951000.556521:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951000.556539:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8127 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.556567:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.556578:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.556588:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2000, rc 0) 00000100:00100000:3.0:1783951000.556654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944881536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (6978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.556661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783951000.556732:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951000.556749:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.556759:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951000.556837:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.556869:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.556899:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951000.556913:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881664 00000100:00100000:3.0:1783951000.556919:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881664 00000100:00100000:3.0:1783951000.556951:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783951000.556958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944881664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.557073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944881664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.557081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783951000.557114:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.557159:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.557204:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.557217:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951000.557229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881792 00000100:00100000:3.0:1783951000.557232:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881792 00000100:00100000:3.0:1783951000.560387:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783951000.560474:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944881792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.560624:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944881792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.560632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783951000.560711:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951000.568037:0:13273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783951000.568314:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783951000.568341:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951000.568354:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.568367:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951000.568378:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951000.568381:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377952800 from 7 10000000:01000000:3.0:1783951000.568384:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951000.568572:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.568581:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.568591:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951000.568615:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.568681:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.568714:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951000.570682:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944881920 00000100:00100000:2.0:1783951000.570697:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944881920 00000100:00100000:2.0:1783951000.570752:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1783951000.570762:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944881920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951000.570780:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951000.570796:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8135 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.570838:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.570850:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.570861:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949c00, rc 0) 00000100:00100000:2.0:1783951000.570934:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944881920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.570943:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1783951000.571059:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944881920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951000.571078:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.571088:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951000.571197:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.571233:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.571345:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951000.571361:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882048 00000100:00100000:3.0:1783951000.571365:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882048 00000100:00100000:3.0:1783951000.571388:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1783951000.571394:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944882048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.571575:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944882048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.571592:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1783951000.571623:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.571647:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.571690:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.571703:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951000.571713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882176 00000100:00100000:3.0:1783951000.571716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882176 00000100:00100000:3.0:1783951000.571733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1783951000.571738:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944882176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.571811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944882176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.571817:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1783951000.571854:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951000.574119:0:13274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783951000.574350:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783951000.574377:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951000.574388:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574478:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951000.574492:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951000.574495:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 7 10000000:01000000:3.0:1783951000.574498:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951000.574538:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574561:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574572:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951000.574597:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.574659:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.574696:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be4900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951000.574714:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882304 00000100:00100000:3.0:1783951000.574720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882304 00000100:00100000:3.0:1783951000.574754:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783951000.574762:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944882304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951000.574774:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951000.574787:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8143 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574808:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574818:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574826:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145c00, rc 0) 00000100:00100000:3.0:1783951000.574863:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944882304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951000.574869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783951000.574919:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951000.574932:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951000.574942:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951000.574991:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.575017:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.575028:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951000.575133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882432 00000100:00100000:2.0:1783951000.575138:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882432 00000100:00100000:2.0:1783951000.575176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783951000.575183:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944882432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.575583:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944882432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.575590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783951000.576326:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.576369:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951000.576548:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951000.576616:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247be4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951000.581924:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882560 00000100:00100000:2.0:1783951000.581940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882560 00000100:00100000:2.0:1783951000.582000:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1783951000.582010:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944882560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.582207:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944882560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.582216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1783951000.582296:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951000.584185:0:13275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783951000.585508:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783951000.585540:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951000.585552:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.585565:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951000.585576:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783951000.585579:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db6000 from 7 10000000:01000000:2.0:1783951000.585581:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951000.585624:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.585633:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.585643:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951000.585679:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.585743:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951000.585777:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951000.585796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882688 00000100:00100000:2.0:1783951000.585802:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882688 00000100:00100000:2.0:1783951000.585842:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783951000.585851:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944882688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951000.585864:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951000.585878:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f8151 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.585909:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.585921:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.585930:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949200, rc 0) 00000100:00100000:2.0:1783951000.585967:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944882688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.585974:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783951000.586017:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951000.586032:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.586042:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951000.586095:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.586119:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951000.586133:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951000.586162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882816 00000100:00100000:2.0:1783951000.586166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882816 00000100:00100000:2.0:1783951000.586190:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1783951000.586196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944882816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.587961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944882816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1759us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.587983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1783951000.588053:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.588097:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.588172:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951000.588199:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951000.588213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944882944 00000100:00100000:2.0:1783951000.588219:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944882944 00000100:00100000:2.0:1783951000.588940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783951000.588951:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944882944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951000.589064:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944882944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951000.589071:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783951000.589121:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944882944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951000.599071:0:13276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783951000.599137:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783951000.599190:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951000.599202:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951000.599215:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951000.673651:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951001.346482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951001.346534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951001.346559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951001.346580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951001.346602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951001.346632:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826176 00000100:00100000:3.0:1783951001.346641:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826176 00000100:00100000:3.0:1783951001.346691:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826432 00000100:00100000:3.0:1783951001.346694:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826432 00000100:00100000:3.0:1783951001.346706:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826048 00000100:00100000:3.0:1783951001.346708:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826048 00000100:00100000:3.0:1783951001.346719:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826304 00000100:00100000:3.0:1783951001.346722:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826304 00000100:00100000:3.0:1783951001.346750:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 195 00000100:00100000:3.0:1783951001.346775:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923826176:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951001.346846:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923826176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951001.346855:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 195 00000100:00100000:3.0:1783951001.346870:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 196 00000100:00100000:3.0:1783951001.346877:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923826432:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951001.346897:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923826432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951001.346904:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 196 00000100:00100000:3.0:1783951001.346915:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 197 00000100:00100000:3.0:1783951001.346921:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923826048:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951001.346941:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923826048:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951001.346948:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 197 00000100:00100000:3.0:1783951001.346958:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 198 00000100:00100000:3.0:1783951001.346963:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923826304:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951001.346998:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923826304:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 19us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951001.347006:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 198 00000100:00080000:3.0:1783951001.347307:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951001.347313:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951001.348586:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923825920 00000100:00100000:1.0:1783951001.348598:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923825920 00000100:00100000:1.0:1783951001.348658:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 336 00000100:00100000:1.0:1783951001.348667:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923825920:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951001.348735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923825920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 68us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951001.348742:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 336 00000100:00100000:2.0:1783951001.698597:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944883072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951001.698675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951001.698752:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883072 00000100:00100000:2.0:1783951001.698772:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883072 00000100:00100000:2.0:1783951001.698820:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783951001.698829:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944883072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951001.698865:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783951001.698912:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944883072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951001.698920:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783951001.698963:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944883072:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951001.699311:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951002.209323:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951002.211019:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944883200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951002.211098:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951002.216100:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883200 00000100:00100000:2.0:1783951002.216114:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883200 00000100:00100000:1.0:1783951002.216662:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783951002.216675:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944883200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951002.216713:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951002.216818:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944883200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (5718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951002.216826:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1783951002.216877:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d8380 x1870607944883200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951002.216979:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951002.217020:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944883200:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1783951002.510964:0:13393:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783951002.721471:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951002.721543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951002.721616:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883328 00000100:00100000:0.0:1783951002.721624:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883328 00000100:00100000:0.0:1783951002.721689:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783951002.721700:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944883328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951002.721723:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951002.721765:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944883328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951002.721773:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1783951002.721793:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783951002.721821:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d8a80 x1870607944883328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951002.721840:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944883328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951002.722083:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951003.749508:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951004.768477:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951004.769272:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944883840:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769375:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.769448:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944884352:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769480:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.769515:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783951004.769522:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944883456:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769556:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.769580:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944883968:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.769627:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944884480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769651:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.769689:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883840 00000100:00100000:0.0:1783951004.769700:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883840 00000100:00100000:0.0:1783951004.769775:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783951004.769788:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944883840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769850:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944883840:12345-0@lo:400:kworker.0 Request processed in 65us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.769858:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783951004.769884:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884352 00000100:00100000:0.0:1783951004.769888:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884352 00000100:00100000:0.0:1783951004.769922:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884480 00000100:00100000:0.0:1783951004.769925:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884480 00000100:00100000:0.0:1783951004.769948:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783951004.769956:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944884352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.769987:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944884352:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.770002:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783951004.770014:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783951004.770023:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770055:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944884480:12345-0@lo:400:kworker.0 Request processed in 35us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.770061:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1783951004.770087:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783951004.770139:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248014a80 x1870607944884480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951004.770179:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944884480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770194:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944883840:0@lo:400:kworker.0 00010000:00080000:0.0:1783951004.770203:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248017800 x1870607944884352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951004.770211:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944884352:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770257:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883456 00000100:00100000:0.0:1783951004.770261:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883456 00000100:00100000:0.0:1783951004.770293:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783951004.770301:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944883456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770338:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944883456:12345-0@lo:400:kworker.0 Request processed in 38us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.770344:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783951004.770388:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944883712:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.770445:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944884224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.770489:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783951004.770496:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944883584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770519:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.770536:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944884096:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.770569:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944884608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951004.770591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.770617:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884608 00000100:00100000:0.0:1783951004.770621:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884608 00000100:00100000:0.0:1783951004.770653:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783951004.770662:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944884608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951004.770690:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951004.770723:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944884608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.770730:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1783951004.770746:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783951004.770762:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d8a80 x1870607944884608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951004.770777:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944884608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951004.770805:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944883456:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770832:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883968 00000100:00100000:0.0:1783951004.770836:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883968 00000100:00100000:0.0:1783951004.770857:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883712 00000100:00100000:0.0:1783951004.770859:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883712 00000100:00100000:0.0:1783951004.770880:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783951004.770886:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770924:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944883968:12345-0@lo:400:kworker.0 Request processed in 39us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.770931:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783951004.770943:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783951004.770951:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944883712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.770986:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944883712:12345-0@lo:400:kworker.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951004.770992:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783951004.771016:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944883712:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.771037:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944883968:0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.771570:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944884992:0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.771608:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951004.771631:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951004.771637:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944884864:0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.771660:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951004.771687:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884992 00000100:00100000:2.0:1783951004.771692:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884992 00000100:00100000:2.0:1783951004.771728:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783951004.771735:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944884992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.771769:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944884992:12345-0@lo:400:kworker.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951004.771775:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1783951004.771800:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0341218380 x1870607944884992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951004.771810:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944884992:0@lo:400:kworker.0 00000100:00080000:2.0:1783951004.771825:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951004.771842:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884224 00000100:00100000:2.0:1783951004.771846:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884224 00000100:00100000:2.0:1783951004.771873:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944883584 00000100:00100000:2.0:1783951004.771876:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944883584 00000100:00100000:2.0:1783951004.771886:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884096 00000100:00100000:2.0:1783951004.771888:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884096 00000100:00100000:2.0:1783951004.771900:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884864 00000100:00100000:2.0:1783951004.771903:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884864 00000100:00100000:2.0:1783951004.771922:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783951004.771928:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944884224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.771960:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944884224:12345-0@lo:400:kworker.0 Request processed in 32us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951004.771966:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783951004.771978:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783951004.771984:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944883584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.772012:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944883584:12345-0@lo:400:kworker.0 Request processed in 28us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951004.772017:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783951004.772029:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783951004.772035:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944884096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.772063:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944884096:12345-0@lo:400:kworker.0 Request processed in 28us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951004.772068:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783951004.772079:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1783951004.772084:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944884864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951004.772217:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951004.772229:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944884736:0@lo:400:kworker.0 00000100:00080000:3.0:1783951004.772595:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951004.772599:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783951004.772639:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0341218700 x1870607944884864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951004.772650:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944884864:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.773462:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944885248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951004.774769:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951004.774833:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944885120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951004.774877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951004.774936:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885120 00000100:00100000:1.0:1783951004.774945:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885120 00000100:00100000:1.0:1783951004.775002:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783951004.775011:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944885120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951004.775041:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951004.775092:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944885120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951004.775108:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1783951004.775175:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02476c8380 x1870607944885120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951004.775197:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944885120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951004.775518:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944884736 00000100:00100000:3.0:1783951004.775523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944884736 00000100:00100000:3.0:1783951004.775598:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783951004.775606:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944884736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951004.775655:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944884736:12345-0@lo:400:kworker.0 Request processed in 51us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951004.775662:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783951004.775758:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944884864:12345-0@lo:400:kworker.0 Request processed in 3672us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951004.775790:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1783951004.777190:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951004.777256:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944884736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.777616:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951004.777724:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944883584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951004.777740:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944884096:0@lo:400:kworker.0 00010000:00080000:0.0:1783951004.777756:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248015f80 x1870607944884224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951004.777767:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944884224:0@lo:400:kworker.0 00000100:00100000:2.0:1783951004.778741:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885248 00000100:00100000:2.0:1783951004.778755:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885248 00000100:00100000:2.0:1783951004.778815:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783951004.778827:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944885248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951004.778881:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783951004.778983:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944885248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951004.778991:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783951004.779213:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944885248:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783951005.792314:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951006.465672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951006.466809:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826560 00000100:00100000:2.0:1783951006.466827:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826560 00000100:00100000:2.0:1783951006.466969:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 338 00000100:00100000:2.0:1783951006.466991:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923826560:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951006.467099:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923826560:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 119us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951006.467108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 338 00000100:00100000:3.0:1783951006.473082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951006.473136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951006.473204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951006.473230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951006.473264:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826688 00000100:00100000:3.0:1783951006.473276:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826688 00000100:00100000:3.0:1783951006.473360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826944 00000100:00100000:3.0:1783951006.473364:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826944 00000100:00100000:3.0:1783951006.473380:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923826816 00000100:00100000:3.0:1783951006.473382:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923826816 00000100:00100000:3.0:1783951006.473394:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923827072 00000100:00100000:3.0:1783951006.473396:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923827072 00000100:00100000:3.0:1783951006.473422:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 205 00000100:00100000:3.0:1783951006.473433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923826688:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951006.473552:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923826688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 120us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951006.473561:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 205 00000100:00100000:3.0:1783951006.473580:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 206 00000100:00100000:3.0:1783951006.473585:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923826944:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951006.473609:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923826944:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951006.473616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 206 00000100:00100000:3.0:1783951006.473627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 207 00000100:00100000:3.0:1783951006.473632:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923826816:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951006.473653:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923826816:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951006.473659:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 207 00000100:00100000:3.0:1783951006.473668:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 208 00000100:00100000:3.0:1783951006.473673:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923827072:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951006.473691:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923827072:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 18us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951006.473697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 208 00000100:00080000:1.0:1783951006.473978:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951006.473983:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951006.816873:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944885376:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951006.816922:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951006.816976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951006.817437:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885376 00000100:00100000:1.0:1783951006.817448:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885376 00000100:00100000:0.0:1783951006.817684:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783951006.817699:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944885376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951006.817754:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783951006.817820:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944885376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951006.817829:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783951006.817910:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944885376:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783951007.313025:0:13541:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:56:45 (1783951005) === 00000100:00100000:1.0:1783951007.328563:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944885504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951007.328663:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951007.328770:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885504 00000100:00100000:2.0:1783951007.328780:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885504 00000100:00100000:2.0:1783951007.328853:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783951007.328865:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944885504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951007.328904:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951007.333475:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944885504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4597us (4796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951007.333494:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1783951007.334329:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783951007.334463:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02469d8a80 x1870607944885504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951007.334493:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944885504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951007.526404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.526491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.526694:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923827200 00000100:00100000:1.0:1783951007.526706:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923827200 00000100:00100000:1.0:1783951007.526792:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1783951007.526814:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923827200:12345-192.168.202.33@tcp:41:mkdir.0 00000004:00000024:1.0:1783951007.526871:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783951007.526989:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923827200:12345-192.168.202.33@tcp:41:mkdir.0 Request processed in 177us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951007.526997:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:2.0:1783951007.527518:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923827328 00000100:00100000:2.0:1783951007.527527:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923827328 00000100:00100000:2.0:1783951007.527588:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:2.0:1783951007.527597:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:10523:x1870607923827328:12345-192.168.202.33@tcp:700:mkdir.0 00000100:00100000:2.0:1783951007.527654:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:10523:x1870607923827328:12345-192.168.202.33@tcp:700:mkdir.0 Request processed in 59us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951007.527662:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:3.0:1783951007.531289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.531391:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923827584 00000100:00100000:0.0:1783951007.531405:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923827584 00000100:00100000:0.0:1783951007.531506:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783951007.531520:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:10523:x1870607923827584:12345-192.168.202.33@tcp:36:mkdir.0 00010000:00010000:0.0:1783951007.531600:0:10105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951007.533641:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f489 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.533692:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109c800) 00010000:00010000:0.0:1783951007.533713:0:10105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951007.533956:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.533968:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.539979:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.540670:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.540687:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.540697:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543365:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543388:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543398:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951007.543415:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084fd4c01 reply state 00000000f48ee6a3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543425:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543432:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937b00) 00010000:00010000:1.0:1783951007.543435:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951007.543439:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783951007.543443:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783951007.543464:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543471:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543477:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543482:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951007.543486:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543502:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543513:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:1.0:1783951007.543515:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951007.543518:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543524:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f815f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951007.543541:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084fd4c01 reply state 00000000f48ee6a3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543549:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.543554:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0246937500) 00010000:00010000:1.0:1783951007.543556:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951007.543564:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783951007.543670:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:10523:x1870607923827584:12345-192.168.202.33@tcp:36:mkdir.0 Request processed in 12150us (12392us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783951007.543680:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:2.0:1783951007.552982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.553106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923827712 00000100:00100000:1.0:1783951007.553128:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923827712 00000100:00100000:1.0:1783951007.553234:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:1.0:1783951007.553246:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:10524:x1870607923827712:12345-192.168.202.33@tcp:101:chmod.0 00010000:00010000:1.0:1783951007.553269:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951007.553300:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f51c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.553375:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f817b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.553390:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f817b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.553402:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f817b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951007.553452:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951007.553456:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951007.553640:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f817b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.553667:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f51c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.553685:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f817b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f51c expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.553712:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:1.0:1783951007.553715:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951007.553718:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67600, rc 0) 00000100:00100000:2.0:1783951007.554531:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:10524:x1870607923827712:12345-192.168.202.33@tcp:101:chmod.0 Request processed in 1283us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951007.554541:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:3.0:1783951007.561103:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.561231:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923827968 00000100:00100000:0.0:1783951007.561247:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923827968 00000100:00100000:0.0:1783951007.561342:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1783951007.561357:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:10524:x1870607923827968:12345-192.168.202.33@tcp:36:chmod.0 00010000:00010000:0.0:1783951007.561414:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951007.561444:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f817b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f51c expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.561464:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:0.0:1783951007.561475:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951007.561706:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.561721:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.561730:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951007.562975:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007623e556 reply state 000000005389cdda transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.562995:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.563003:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:0.0:1783951007.563006:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783951007.563009:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783951007.563855:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783951007.563963:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:10524:x1870607923827968:12345-192.168.202.33@tcp:36:chmod.0 Request processed in 2606us (2870us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783951007.563972:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:3.0:1783951007.606925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.607127:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923828096 00000100:00100000:1.0:1783951007.607192:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923828096 00000100:00100000:1.0:1783951007.607273:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:1.0:1783951007.607284:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:10525:x1870607923828096:12345-192.168.202.33@tcp:101:chown.0 00010000:00010000:1.0:1783951007.607316:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951007.607352:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f523 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.607441:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8190 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.607459:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.607473:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951007.607538:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951007.607543:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951007.607592:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.607629:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f523 expref: 11 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.607678:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f523 expref: 10 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.607688:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:1.0:1783951007.607691:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951007.607695:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66400, rc 0) 00000100:00100000:1.0:1783951007.607790:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:10525:x1870607923828096:12345-192.168.202.33@tcp:101:chown.0 Request processed in 507us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951007.607800:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:2.0:1783951007.615101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.620765:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923828224 00000100:00100000:3.0:1783951007.620810:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923828224 00000100:00100000:3.0:1783951007.620897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:3.0:1783951007.620909:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:10525:x1870607923828224:12345-192.168.202.33@tcp:101:chown.0 00010000:00010000:3.0:1783951007.620937:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951007.620963:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f52a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621053:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621070:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621082:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621095:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621101:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621107:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621237:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f81ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621246:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f81ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621692:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f81ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951007.621863:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951007.621868:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951007.621898:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f81ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621914:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621920:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621927:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621933:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951007.621938:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621946:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621960:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:3.0:1783951007.621964:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951007.621982:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.621990:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f819e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622011:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622028:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622034:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622039:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951007.622043:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622049:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622058:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0246937500) 00010000:00010000:3.0:1783951007.622061:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951007.622064:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622070:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622106:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f52a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622121:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f81ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f52a expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.622130:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937b00) 00010000:00010000:3.0:1783951007.622132:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951007.622174:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145a00, rc 0) 00000100:00100000:3.0:1783951007.623125:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:10525:x1870607923828224:12345-192.168.202.33@tcp:101:chown.0 Request processed in 2212us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951007.623137:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:2.0:1783951007.626975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.627110:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923828352 00000100:00100000:3.0:1783951007.627123:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923828352 00000100:00100000:3.0:1783951007.627630:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:3.0:1783951007.627644:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:10525:x1870607923828352:12345-192.168.202.33@tcp:900:chown.0 00000100:00100000:3.0:1783951007.627788:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:10525:x1870607923828352:12345-192.168.202.33@tcp:900:chown.0 Request processed in 147us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951007.627797:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:1.0:1783951007.631491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.631682:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923828608 00000100:00100000:3.0:1783951007.631696:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923828608 00000100:00100000:2.0:1783951007.632024:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:2.0:1783951007.632039:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:10525:x1870607923828608:12345-192.168.202.33@tcp:36:chown.0 00010000:00010000:2.0:1783951007.632115:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951007.632197:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f81ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f52a expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.632226:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937b00) 00010000:00010000:2.0:1783951007.632233:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951007.632455:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.632473:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.632485:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951007.635647:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1783951007.635824:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635838:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635846:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635853:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951007.635858:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635865:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635881:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0246937500) 00010000:00010000:3.0:1783951007.635894:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951007.635899:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635905:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8166 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635927:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635933:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635938:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635943:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951007.635946:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635951:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635959:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937b00) 00010000:00010000:3.0:1783951007.635961:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951007.635964:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635969:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f816d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635983:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.635999:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.636005:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.636010:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5dc00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951007.636014:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.636019:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.636027:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:3.0:1783951007.636029:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783951007.636032:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.636037:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8182 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951007.636591:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f39087d4 reply state 000000003ee2f67f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.636616:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.636627:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937b00) 00010000:00010000:1.0:1783951007.636629:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783951007.636633:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783951007.636649:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1783951007.636794:0:6527:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1783951007.636820:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:10525:x1870607923828608:12345-192.168.202.33@tcp:36:chown.0 Request processed in 4780us (5342us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783951007.636828:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00010000:00010000:0.0:1783951007.637067:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.637088:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.637095:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.637100:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951007.637103:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.637120:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.637129:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937b00) 00010000:00010000:0.0:1783951007.637131:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951007.637135:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.637819:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f81b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951007.659239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.659317:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923828736 00000100:00100000:3.0:1783951007.659328:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923828736 00000100:00100000:3.0:1783951007.659395:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1783951007.659405:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:10526:x1870607923828736:12345-192.168.202.33@tcp:101:touch.500 00010000:00010000:3.0:1783951007.659431:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951007.659451:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f81ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f531 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951007.674580:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 15072us 00010000:00010000:1.0:1783951007.685681:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685704:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685725:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685743:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685749:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685755:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685897:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f81cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685906:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f81cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.685913:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f81cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951007.685945:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951007.685949:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951007.685988:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f81cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686000:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686006:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686023:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686029:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951007.686032:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686039:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686051:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:1.0:1783951007.686054:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951007.686058:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686064:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169f81c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686074:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686697:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686703:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686708:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951007.686711:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686728:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686737:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0246937600) 00010000:00010000:1.0:1783951007.686739:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951007.686742:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686749:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f81c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686850:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f81ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f531 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686870:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f81cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f531 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.686879:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951007.686881:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951007.686883:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67000, rc 0) 00000100:00100000:1.0:1783951007.686953:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:10526:x1870607923828736:12345-192.168.202.33@tcp:101:touch.500 Request processed in 27547us (27721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951007.686962:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1783951007.694598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.695727:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923828992 00000100:00100000:0.0:1783951007.695740:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923828992 00000100:00100000:0.0:1783951007.695843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:0.0:1783951007.695857:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:10526:x1870607923828992:12345-192.168.202.33@tcp:101:touch.500 00010000:00010000:0.0:1783951007.695880:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951007.695900:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f81d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f538 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696011:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696026:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696036:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696110:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696129:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696136:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951007.696564:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1783951007.696716:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f81eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696725:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f81eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696733:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f81eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696769:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696776:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696782:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696788:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5cc00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951007.696792:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696799:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696821:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951007.696824:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951007.696828:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696834:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f81dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951007.696847:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036cbc643 reply state 000000007394f128 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696858:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696864:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff9e0247832000) 00010000:00010000:0.0:1783951007.696867:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951007.696869:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951007.696897:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f81d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f538 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696912:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f81eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f538 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.696919:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e0247832e00) 00010000:00010000:0.0:1783951007.696921:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951007.696924:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c400, rc 0) 00000100:00100000:0.0:1783951007.697006:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:10526:x1870607923828992:12345-192.168.202.33@tcp:101:touch.500 Request processed in 1152us (2417us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783951007.697014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:1.0:1783951007.704373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.704462:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923829248 00000100:00100000:3.0:1783951007.704472:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923829248 00000100:00100000:3.0:1783951007.704533:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:3.0:1783951007.704542:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:10526:x1870607923829248:12345-192.168.202.33@tcp:36:touch.500 00010000:00010000:3.0:1783951007.704611:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951007.704639:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f81eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f538 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.704658:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e0247832e00) 00010000:00010000:3.0:1783951007.704670:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951007.704732:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.704746:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.704755:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951007.704873:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c582b2f reply state 00000000a3cd930a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.704887:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.704893:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:3.0:1783951007.704895:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951007.704898:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951007.704998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:10526:x1870607923829248:12345-192.168.202.33@tcp:36:touch.500 Request processed in 456us (633us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783951007.705019:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:3.0:1783951007.709846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.709924:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923829376 00000100:00100000:1.0:1783951007.709935:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923829376 00000100:00100000:1.0:1783951007.710000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1783951007.710011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:10526:x1870607923829376:12345-192.168.202.33@tcp:101:touch.500 00010000:00010000:1.0:1783951007.710044:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951007.710067:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f8200 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f53f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.710132:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f8200 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f53f expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.710243:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f8200 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f53f expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.710266:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:1.0:1783951007.710268:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951007.710272:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66c00, rc 0) 00000100:00100000:1.0:1783951007.711066:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:10526:x1870607923829376:12345-192.168.202.33@tcp:101:touch.500 Request processed in 1052us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951007.711076:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1783951007.717984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.718203:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923829504 00000100:00100000:0.0:1783951007.718213:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923829504 00000100:00100000:0.0:1783951007.718270:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:0.0:1783951007.718278:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870607923829504:12345-192.168.202.33@tcp:8:touch.500 00010000:00080000:0.0:1783951007.718319:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:0.0:1783951007.718361:0:8440:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f8207 00002000:00100000:0.0:1783951007.718374:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75392fba-af18-4ae6-9b8a-6f1db7dcbeed/ffff9e0248050000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783951007.718395:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783951007.718486:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951007.718515:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e0248053000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951007.718588:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923829504:12345-192.168.202.33@tcp:8:touch.500 Request processed in 308us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951007.718595:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:2.0:1783951007.730477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.732186:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923829632 00000100:00100000:0.0:1783951007.732198:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923829632 00000100:00100000:0.0:1783951007.732297:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1783951007.732310:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923829632:12345-192.168.202.33@tcp:2:touch.500 00000100:00080000:1.0:1783951007.733167:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1783951007.734054:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1783951007.734065:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000100:00100000:0.0:1783951007.734650:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:0:x1870607923829632:12345-192.168.202.33@tcp:2:touch.500 Request processed in 1998us (3837us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783951007.734663:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:3.0:1783951007.737963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.738201:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923829888 00000100:00100000:1.0:1783951007.738211:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923829888 00000100:00100000:1.0:1783951007.738275:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:1.0:1783951007.738285:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:10526:x1870607923829888:12345-192.168.202.33@tcp:35:touch.500 00000100:00100000:1.0:1783951007.738617:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:10526:x1870607923829888:12345-192.168.202.33@tcp:35:touch.500 Request processed in 332us (662us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783951007.738625:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:1.0:1783951007.771641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.771758:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923830016 00000100:00100000:0.0:1783951007.771768:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923830016 00000100:00100000:0.0:1783951007.771838:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:0.0:1783951007.771848:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:10527:x1870607923830016:12345-192.168.202.33@tcp:101:rm.0 00010000:00010000:0.0:1783951007.771871:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951007.771901:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f820e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f546 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.771962:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f8215 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.771976:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f8215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.771988:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f8215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951007.772034:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951007.772037:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951007.772070:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f8215 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.772095:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f820e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f546 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.772113:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f8215 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f546 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.772122:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951007.772126:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951007.772129:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5cc00, rc 0) 00000100:00100000:2.0:1783951007.772953:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:10527:x1870607923830016:12345-192.168.202.33@tcp:101:rm.0 Request processed in 1101us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951007.772965:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:3.0:1783951007.782634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951007.782803:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923830272 00000100:00100000:0.0:1783951007.782813:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923830272 00000100:00100000:0.0:1783951007.782890:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:0.0:1783951007.782902:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:10527:x1870607923830272:12345-192.168.202.33@tcp:101:rm.0 00010000:00010000:0.0:1783951007.782938:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951007.782962:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f821c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f54d expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951007.783074:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783951007.783276:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f821c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f54d expref: 16 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.783290:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:0.0:1783951007.783294:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951007.783298:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f821c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f54d expref: 16 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951007.783312:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951007.783374:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:10527:x1870607923830272:12345-192.168.202.33@tcp:101:rm.0 Request processed in 475us (749us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1783951007.783382:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:2.0:1783951007.788653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.788801:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923830400 00000100:00100000:1.0:1783951007.788822:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923830400 00000100:00100000:1.0:1783951007.788879:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1783951007.788888:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:10527:x1870607923830400:12345-192.168.202.33@tcp:37:rm.0 00000100:00100000:3.0:1783951007.793064:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:10527:x1870607923830400:12345-192.168.202.33@tcp:37:rm.0 Request processed in 4165us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951007.793079:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:3.0:1783951007.805573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951007.805791:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923830656 00000100:00100000:2.0:1783951007.805801:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923830656 00000100:00100000:2.0:1783951007.805868:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783951007.805879:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03494c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:10527:x1870607923830656:12345-192.168.202.33@tcp:35:rm.0 00000100:00100000:2.0:1783951007.806117:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03494c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:10527:x1870607923830656:12345-192.168.202.33@tcp:35:rm.0 Request processed in 239us (552us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783951007.806125:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783951007.812427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.813306:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923830912 00000100:00100000:1.0:1783951007.813317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923830912 00000100:00100000:1.0:1783951007.813400:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:1.0:1783951007.813410:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:10527:x1870607923830912:12345-192.168.202.33@tcp:101:rm.0 00010000:00010000:1.0:1783951007.813434:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951007.813455:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f822a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f554 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.813563:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8231 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.813577:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8231 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.813587:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8231 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951007.813598:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783951007.813707:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f822a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f554 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.813725:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8231 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f554 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.813732:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951007.813735:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951007.813752:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66a00, rc 0) 00000100:00100000:1.0:1783951007.813818:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923830912:12345-192.168.202.33@tcp:101:rm.0 Request processed in 409us (1401us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783951007.813831:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:1.0:1783951007.819532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951007.819598:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923831040 00000100:00100000:2.0:1783951007.819610:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923831040 00000100:00100000:2.0:1783951007.819727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:2.0:1783951007.819739:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923831040:12345-192.168.202.33@tcp:41:rm.0 00000004:00000024:2.0:1783951007.819805:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1783951007.819882:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923831040:12345-192.168.202.33@tcp:41:rm.0 Request processed in 145us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951007.819891:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:2.0:1783951007.822722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951007.822851:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923831168 00000100:00100000:3.0:1783951007.822861:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923831168 00000100:00100000:3.0:1783951007.822925:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:3.0:1783951007.822935:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923831168:12345-192.168.202.33@tcp:101:rm.0 00010000:00010000:3.0:1783951007.822955:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951007.822974:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f823f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f55b expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.823035:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.823049:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.823059:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.823069:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.823089:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951007.823095:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823499:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823514:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823522:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951007.823562:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783951007.823566:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951007.823582:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823593:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823602:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823609:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823616:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823621:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951007.823625:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823633:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823644:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:2.0:1783951007.823652:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951007.823656:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823663:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8246 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823678:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823684:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823690:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823694:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951007.823697:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823702:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823709:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff9e0247832000) 00010000:00010000:2.0:1783951007.823712:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951007.823714:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823720:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f824d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823744:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f823f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f55b expref: 20 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823767:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f55b expref: 19 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.823774:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:2.0:1783951007.823776:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951007.823778:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948a00, rc 0) 00000100:00100000:2.0:1783951007.823841:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:10527:x1870607923831168:12345-192.168.202.33@tcp:101:rm.0 Request processed in 907us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951007.823848:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:3.0:1783951007.828733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951007.828886:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923831424 00000100:00100000:1.0:1783951007.828897:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923831424 00000100:00100000:1.0:1783951007.829010:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:1.0:1783951007.829020:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:10527:x1870607923831424:12345-192.168.202.33@tcp:36:rm.0 00010000:00010000:1.0:1783951007.829076:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783951007.829104:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8254 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f55b expref: 19 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829126:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169f8200 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f53f expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829136:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:1.0:1783951007.829188:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f8215 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f546 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829198:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951007.829201:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951007.829222:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829236:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829244:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829282:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829289:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829296:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829400:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829408:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829415:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951007.829644:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1783951007.829654:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363477511418ns, next at 364477508832ns, rc = 0 00010000:00010000:1.0:1783951007.829700:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829709:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829715:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829722:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829739:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829745:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829760:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951007.829778:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829784:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829790:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829796:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951007.829801:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829808:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829816:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:1.0:1783951007.829819:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783951007.829823:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829828:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8269 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829843:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829854:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829860:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829865:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951007.829868:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829874:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829882:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951007.829884:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951007.829887:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829892:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f825b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951007.829902:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6de9338 reply state 00000000a68ead17 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829912:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951007.829917:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff9e0247832000) 00010000:00010000:1.0:1783951007.829919:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951007.829922:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951007.830482:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923831424:12345-192.168.202.33@tcp:36:rm.0 Request processed in 1460us (1755us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783951007.830498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00010000:00010000:2.0:1783951007.830764:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951007.830773:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.830782:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951007.830786:0:9537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.830794:0:9537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.830808:0:9537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:2.0:1783951007.830811:0:9537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951007.830814:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.830820:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8270 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.830833:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951007.830844:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951007.830846:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951007.835220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951007.835326:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923831680 00000100:00100000:2.0:1783951007.835363:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923831680 00000100:00100000:2.0:1783951007.835419:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:2.0:1783951007.835428:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923831680:12345-192.168.202.33@tcp:35:rm.0 00000100:00100000:2.0:1783951007.835641:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:10527:x1870607923831680:12345-192.168.202.33@tcp:35:rm.0 Request processed in 214us (430us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783951007.835649:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:0.0:1783951007.838527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951007.838599:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923831936 00000100:00100000:2.0:1783951007.838610:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923831936 00000100:00100000:2.0:1783951007.838673:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:2.0:1783951007.838683:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:10527:x1870607923831936:12345-192.168.202.33@tcp:36:rm.0 00010000:00010000:2.0:1783951007.838743:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783951007.838772:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8231 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f554 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838792:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f81cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f531 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838801:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:2.0:1783951007.838818:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8190 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f523 expref: 17 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838827:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832400) 00010000:00010000:2.0:1783951007.838833:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951007.838858:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838883:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838894:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838909:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838916:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.838922:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839003:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839011:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839018:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951007.839286:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783951007.839299:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839318:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839325:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839345:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951007.839349:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839357:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839365:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e03438c0900) 00010000:00010000:2.0:1783951007.839368:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783951007.839371:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839376:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8285 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839393:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839399:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839405:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839410:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951007.839413:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839418:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839433:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03438c0600) 00010000:00010000:2.0:1783951007.839435:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951007.839438:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839444:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f8277 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951007.839454:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000610812f5 reply state 000000009b2947a5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839464:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951007.839470:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e03438c0d00) 00010000:00010000:2.0:1783951007.839472:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951007.839475:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951007.839539:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:10527:x1870607923831936:12345-192.168.202.33@tcp:36:rm.0 Request processed in 858us (1021us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783951007.839546:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:3.0:1783951007.840317:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951007.840347:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944885632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951007.840396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951007.841206:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951007.846363:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885632 00000100:00100000:0.0:1783951007.846378:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885632 00000100:00100000:0.0:1783951007.846578:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783951007.846590:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944885632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951007.846617:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951007.846707:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944885632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (6310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951007.846715:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1783951007.848401:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abf480 x1870607944885632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951007.848425:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944885632:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951007.852598:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951008.864360:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783951009.888352:0:9859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365536207457ns, next at 366536204679ns, rc = 0 00000100:00100000:1.0:1783951009.888417:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951009.888437:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944885760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951009.888508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951009.888568:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951009.888582:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885760 00000100:00100000:1.0:1783951009.888589:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885760 00000100:00100000:1.0:1783951009.888645:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783951009.888655:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944885760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951009.888687:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951009.888748:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944885760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951009.888755:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1783951009.888776:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783951009.888809:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247af8000 x1870607944885760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951009.888827:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944885760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951009.889033:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944885888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951009.889066:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.889099:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944885888 00000100:00100000:3.0:1783951009.889104:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944885888 00000100:00100000:3.0:1783951009.889132:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783951009.889138:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944885888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951009.889196:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783951009.889230:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944885888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.889236:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783951009.889307:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944885888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951009.889735:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951009.889756:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944886016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951009.889785:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951009.889852:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886016 00000100:00100000:1.0:1783951009.889857:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886016 00000100:00100000:1.0:1783951009.889913:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783951009.889920:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944886016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951009.889940:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951009.889974:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944886016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951009.889980:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1783951009.890032:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783951009.890052:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247af8000 x1870607944886016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951009.890068:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944886016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951009.890823:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951009.890931:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951009.890944:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944886272:0@lo:400:kworker.0 00000100:00100000:1.0:1783951009.890986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.891084:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886272 00000100:00100000:3.0:1783951009.891089:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886272 00000100:00100000:3.0:1783951009.891134:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783951009.891160:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944886272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.891207:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944886272:12345-0@lo:400:kworker.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.891215:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783951009.891246:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944886272:0@lo:400:kworker.0 00000100:00100000:2.0:1783951009.891433:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944886144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951009.891469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.891538:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886144 00000100:00100000:3.0:1783951009.891542:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886144 00000100:00100000:3.0:1783951009.891576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1783951009.891582:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944886144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.891616:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944886144:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.891622:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783951009.891688:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944886144:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.891901:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944886400:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.891931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951009.891980:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886400 00000100:00100000:2.0:1783951009.891984:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886400 00000100:00100000:2.0:1783951009.892009:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783951009.892014:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944886400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951009.892405:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944886528:0@lo:400:kworker.0 00000100:00100000:1.0:1783951009.892434:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951009.892551:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944886400:12345-0@lo:400:kworker.0 Request processed in 535us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951009.892558:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783951009.892591:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886528 00000100:00100000:2.0:1783951009.892594:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886528 00000100:00100000:2.0:1783951009.892657:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783951009.892664:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951009.892703:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944886528:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951009.892709:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783951009.892747:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944886400:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.896734:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944886656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.896816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.896855:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944887168:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.896890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.896915:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783951009.896922:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944886784:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.896944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.896962:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944887296:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.896984:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.897034:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886656 00000100:00100000:3.0:1783951009.897041:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886656 00000100:00100000:3.0:1783951009.897088:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887168 00000100:00100000:3.0:1783951009.897092:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887168 00000100:00100000:3.0:1783951009.897108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886784 00000100:00100000:3.0:1783951009.897111:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886784 00000100:00100000:3.0:1783951009.897125:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887296 00000100:00100000:3.0:1783951009.897128:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887296 00000100:00100000:3.0:1783951009.897161:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783951009.897170:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944886656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944886656:12345-0@lo:400:kworker.0 Request processed in 55us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.897232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783951009.897250:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783951009.897256:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944887168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897284:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944887168:12345-0@lo:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.897290:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783951009.897301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783951009.897328:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944886784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897356:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944886784:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.897361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783951009.897374:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1783951009.897380:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944887296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897404:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944887296:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.897409:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:3.0:1783951009.897432:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951009.897436:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783951009.897462:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abf800 x1870607944886784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951009.897476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944886784:0@lo:400:kworker.0 00010000:00080000:3.0:1783951009.897486:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248014e00 x1870607944887296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951009.897494:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944887296:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897503:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944886656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897513:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944887168:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897541:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944886912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897569:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.897591:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951009.897598:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944887040:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951009.897656:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944886912 00000100:00100000:3.0:1783951009.897660:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944886912 00000100:00100000:3.0:1783951009.897689:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887040 00000100:00100000:3.0:1783951009.897692:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887040 00000100:00100000:3.0:1783951009.897712:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783951009.897718:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944886912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897752:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944886912:12345-0@lo:400:kworker.0 Request processed in 34us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.897757:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783951009.897769:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783951009.897775:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944887040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.897800:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944887040:12345-0@lo:400:kworker.0 Request processed in 25us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951009.897805:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1783951009.897827:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951009.897843:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abf480 x1870607944887040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951009.897853:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944887040:0@lo:400:kworker.0 00010000:00080000:3.0:1783951009.897863:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abc380 x1870607944886912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951009.897870:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944886912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951009.899395:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944886528:0@lo:400:kworker.0 00010000:00010000:1.0:1783951010.912725:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951011.299635:0:13689:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1783951011.589951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951011.590021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951011.590060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951011.590087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951011.590111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951011.590134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951011.590265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832064 00000100:00100000:2.0:1783951011.590284:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832064 00000100:00100000:2.0:1783951011.590352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 340 00000100:00100000:2.0:1783951011.590363:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923832064:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951011.590431:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923832064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951011.590439:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 340 00000100:00100000:3.0:1783951011.591402:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832320 00000100:00100000:3.0:1783951011.591410:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832320 00000100:00100000:3.0:1783951011.591481:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832576 00000100:00100000:3.0:1783951011.591484:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832576 00000100:00100000:3.0:1783951011.591497:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832192 00000100:00100000:3.0:1783951011.591499:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832192 00000100:00100000:3.0:1783951011.591510:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832704 00000100:00100000:3.0:1783951011.591513:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832704 00000100:00100000:3.0:1783951011.591527:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 215 00000100:00100000:3.0:1783951011.591534:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923832320:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951011.591578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923832320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 44us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951011.591585:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 215 00000100:00100000:3.0:1783951011.591602:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 216 00000100:00100000:3.0:1783951011.591611:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923832576:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951011.591633:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923832576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951011.591639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 216 00000100:00100000:3.0:1783951011.591650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 217 00000100:00100000:3.0:1783951011.591656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2407:x1870607923832192:12345-192.168.202.33@tcp:400:kworker.0 00000100:00080000:2.0:1783951011.591893:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951011.591898:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951011.591904:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 218 00000100:00100000:1.0:1783951011.591913:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923832704:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951011.591937:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832448 00000100:00100000:2.0:1783951011.591942:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832448 00000100:00100000:1.0:1783951011.591942:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923832704:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951011.591947:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 218 00000100:00100000:2.0:1783951011.592001:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00100000:2.0:1783951011.592009:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923832448:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951011.592047:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923832448:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951011.592063:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00080000:2.0:1783951011.592083:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951011.593923:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2407:x1870607923832192:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 2255us (3823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951011.593940:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 217 00000100:00100000:2.0:1783951011.942291:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944887424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951011.942367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951011.942806:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887424 00000100:00100000:0.0:1783951011.942815:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887424 00000100:00100000:0.0:1783951011.942868:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783951011.942878:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944887424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951011.942911:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783951011.942958:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944887424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951011.942966:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783951011.943473:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944887424:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783951011.948765:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951012.450638:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944887552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951012.450708:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951012.451015:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887552 00000100:00100000:0.0:1783951012.451025:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887552 00000100:00100000:0.0:1783951012.451096:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783951012.451119:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944887552:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951012.451227:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783951012.451400:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951012.451459:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944887552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 355us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951012.451467:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1783951012.451552:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e4e00 x1870607944887552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951012.451571:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944887552:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1783951012.511493:0:13737:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb608c430 20000000:00000080:3.0:1783951012.511511:0:13737:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0247becc00 uarg=0000000000000000 20000000:01000000:3.0:1783951012.511629:0:13737:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783951012.511636:0:13737:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783951012.511640:0:13737:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783951012.512624:0:13738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783951012.512993:0:13737:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783951012.520855:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783951012.520903:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783951012.520938:0:13737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783951012.520960:0:13737:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783951012.520979:0:13737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521000:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521008:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521017:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521024:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521032:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521039:0:13737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521064:0:13737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521104:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521119:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 23 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.521181:0:13737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944887680:0@lo:104: 00000100:00100000:3.0:1783951012.521256:0:13737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951012.521440:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521450:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 23 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.521460:0:13737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944887808:0@lo:104: 00010000:00010000:3.0:1783951012.521490:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521499:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 23 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.521507:0:13737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944887936:0@lo:104: 00010000:00010000:3.0:1783951012.521610:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521619:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 23 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.521636:0:13737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944888064:0@lo:104: 00010000:00010000:3.0:1783951012.521668:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521677:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 12 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.521688:0:13737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944888192:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951012.521744:0:13737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951012.521752:0:13737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.521761:0:13737:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944888320:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951012.521783:0:13737:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03494e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951012.522035:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783951012.522058:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951012.522089:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951012.522105:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951012.522114:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887680 00000100:00100000:2.0:1783951012.522120:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887680 00000100:00100000:2.0:1783951012.522178:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887808 00000100:00100000:2.0:1783951012.522181:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887808 00000100:00100000:2.0:1783951012.522192:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944887936 00000100:00100000:2.0:1783951012.522194:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944887936 00000100:00100000:2.0:1783951012.522213:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944888064 00000100:00100000:2.0:1783951012.522217:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944888064 00000100:00100000:2.0:1783951012.522231:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951012.522240:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+6:13737:x1870607944887680:12345-0@lo:104: 00010000:00010000:2.0:1783951012.522251:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.522318:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951012.522324:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+6:13737:x1870607944887680:12345-0@lo:104: Request processed in 86us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951012.522331:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951012.522371:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951012.522377:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:13737:x1870607944887808:12345-0@lo:104: 00010000:00010000:2.0:1783951012.522384:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.522426:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783951012.522431:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+5:13737:x1870607944887808:12345-0@lo:104: Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951012.522438:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951012.522452:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951012.522457:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:13737:x1870607944887936:12345-0@lo:104: 00010000:00010000:2.0:1783951012.522465:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.522496:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783951012.522501:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+4:13737:x1870607944887936:12345-0@lo:104: Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951012.522506:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951012.522694:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951012.522703:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:13737:x1870607944888064:12345-0@lo:104: 00010000:00010000:2.0:1783951012.522711:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.522740:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783951012.522745:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1065061-5fe9-438e-843f-5f70939080ee+3:13737:x1870607944888064:12345-0@lo:104: Request processed in 45us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951012.522750:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1783951012.522777:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783951012.522782:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.522790:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951012.522875:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.522884:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951012.522891:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951012.522897:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951012.522997:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523004:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951012.523024:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523032:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247948400/0x7645c8e1169f8151 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f8158 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523046:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951012.523050:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523055:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951012.523057:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523063:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951012.523080:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951012.523084:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951012.523098:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523103:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951012.523108:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523115:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f8143 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f814a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523124:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951012.523126:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523132:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951012.523134:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.523164:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951012.523171:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951012.523175:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951012.523198:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.524562:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951012.524572:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.524582:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951012.524585:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.524607:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951012.524613:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951012.524618:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951012.524642:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.524648:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951012.524668:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.524694:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f8127 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f812e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.524706:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951012.524708:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951012.524709:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951012.524715:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951012.524729:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944888832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951012.524781:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951012.524886:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944888448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951012.524910:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951012.524928:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951012.524934:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944888576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951012.524958:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951012.524995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944888832 00000100:00100000:1.0:1783951012.525002:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944888832 00010000:00010000:1.0:1783951012.525029:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 24 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951012.525052:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944888448 00000100:00100000:1.0:1783951012.525055:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944888448 00010000:00010000:1.0:1783951012.525066:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 25 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951012.525077:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944888576 00000100:00100000:1.0:1783951012.525079:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944888576 00010000:00010000:1.0:1783951012.525087:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 26 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951012.525099:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951012.525105:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+26:3654:x1870607944888832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951012.525116:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951012.525122:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 26 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.525132:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 26 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.525171:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951012.525203:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+26:3654:x1870607944888832:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951012.525211:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951012.525227:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951012.525232:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+25:3652:x1870607944888448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951012.525247:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951012.525252:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 25 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.525262:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 25 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.525271:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951012.525311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+25:3652:x1870607944888448:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951012.525317:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951012.525329:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951012.525335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944888576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951012.525342:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951012.525346:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 24 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.525354:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 24 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.525362:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951012.525382:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944888576:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951012.525387:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951012.525424:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944888832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951012.525447:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944888576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951012.525455:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944888448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951012.526891:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951012.526935:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.526946:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2c00/0x7645c8e1169f8135 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f813c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.526967:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951012.526969:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951012.526972:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951012.526992:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951012.527009:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944888704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951012.527064:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951012.527111:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944888704 00000100:00100000:2.0:1783951012.527118:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944888704 00010000:00010000:2.0:1783951012.527159:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 24 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951012.527184:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951012.527193:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944888704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951012.527206:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951012.527211:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 24 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.527222:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 24 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.527239:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951012.527285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944888704:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951012.527306:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951012.527343:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944888704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951012.527644:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949200/0x7645c8e1169f8158 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f8151 expref: 23 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.527657:0:13737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944887680:0@lo:104: 00010000:00010000:3.0:1783951012.527673:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f814a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f8143 expref: 22 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.527684:0:13737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944887808:0@lo:104: 00010000:00010000:3.0:1783951012.527697:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949c00/0x7645c8e1169f813c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f8135 expref: 21 pid: 6519 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.527719:0:13737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944887936:0@lo:104: 00010000:00010000:3.0:1783951012.527734:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2000/0x7645c8e1169f812e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f8127 expref: 20 pid: 6520 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.527743:0:13737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944888064:0@lo:104: 00000100:00100000:3.0:1783951012.527755:0:13737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944888192:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951012.533738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951012.533790:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832832 00000100:00100000:1.0:1783951012.533800:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832832 00010000:00010000:1.0:1783951012.533838:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 13 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951012.533883:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:1.0:1783951012.533893:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923832832:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951012.533911:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951012.533916:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 13 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.533929:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 13 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.533947:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f8120 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f515 expref: 13 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951012.533961:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951012.534015:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:2408:x1870607923832832:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951012.534023:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:3.0:1783951012.534133:0:13737:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13737:1870607944888320:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951012.534215:0:13737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951012.534401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951012.534856:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923832960 00000100:00100000:2.0:1783951012.534863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923832960 00010000:00010000:2.0:1783951012.534888:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951012.534958:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:2.0:1783951012.534968:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:2407:x1870607923832960:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951012.534980:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951012.534985:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.534997:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535010:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f8119 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f50e expref: 12 pid: 6517 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535028:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535036:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535052:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535072:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535079:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535086:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535092:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951012.535096:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535104:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535124:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951012.535159:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951012.535192:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:2407:x1870607923832960:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 226us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951012.535199:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00010000:00010000:0.0:1783951012.535474:0:13737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951012.535482:0:13737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951012.535494:0:13737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f828c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951012.960683:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951012.960707:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944888960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951012.960773:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951012.961106:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944888960 00000100:00100000:1.0:1783951012.961114:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944888960 00000100:00100000:1.0:1783951012.961397:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783951012.961409:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944888960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951012.961433:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951012.961485:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944888960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951012.961561:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1783951012.961586:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783951012.961674:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1783951012.961689:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abc380 x1870607944888960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951012.961711:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944888960:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1783951013.388950:0:13786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc93330a40 20000000:00000080:2.0:1783951013.388973:0:13786:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0248194400 uarg=0000000000000000 20000000:01000000:2.0:1783951013.389027:0:13786:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1783951013.389094:0:13786:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1783951013.389100:0:13786:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1783951013.396392:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1783951013.396667:0:13786:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1783951013.396805:0:13786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1783951013.401676:0:13786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1783951013.401772:0:13786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1783951013.401798:0:13786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783951013.401827:0:13786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401850:0:13786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401863:0:13786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401871:0:13786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401879:0:13786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401888:0:13786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401900:0:13786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5dc00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951013.401905:0:13786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401914:0:13786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401949:0:13786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401958:0:13786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.401965:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f8293 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783951013.408243:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1783951013.408296:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1783951013.408307:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783951013.408589:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408606:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408614:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408620:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951013.408626:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408634:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408657:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff9e0247832000) 00010000:00010000:0.0:1783951013.408660:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951013.408666:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408672:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d000/0x7645c8e1169f81e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408709:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408715:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951013.408716:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944889088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783951013.408720:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408725:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951013.408728:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408732:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408740:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e024109c600) 00010000:00010000:0.0:1783951013.408742:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951013.408745:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408750:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f81f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408770:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408775:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408780:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408791:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951013.408794:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408799:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951013.408806:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783951013.408807:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff9e0247832000) 00010000:00010000:0.0:1783951013.408809:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951013.408812:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408817:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8262 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408833:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408839:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408844:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408848:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951013.408851:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408856:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408871:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e03438c0d00) 00010000:00010000:0.0:1783951013.408874:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951013.408877:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.408882:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f827e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951013.410270:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889088 00000100:00100000:3.0:1783951013.410297:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889088 00000100:00100000:3.0:1783951013.410378:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951013.410391:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944889088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783951013.410431:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1783951013.410478:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a54ee9f, atime: 0x6a54ee9f, ctime: 0x6a54ee9f, blocks: 0x0 00010000:00010000:3.0:1783951013.410486:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.410506:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1783951013.410512:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951013.410531:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.410551:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.410563:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.410571:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.410594:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1783951013.410680:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951013.410852:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944889088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 463us (2043us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783951013.410860:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1783951013.411104:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951013.411113:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.411122:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951013.411126:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783951013.411127:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0341219880/2, rc 0, transno 4294967301 00000100:00100000:1.0:1783951013.411135:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944889088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783951013.411136:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.411182:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.411190:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f829a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.411221:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951013.411224:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951013.411226:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783951013.920330:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951013.920343:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0241aa4000 from 7 10000000:01000000:1.0:1783951013.920350:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951013.920431:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.920445:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.920460:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951013.920495:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.920592:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.920687:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.923615:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889216 00000100:00100000:2.0:1783951013.923637:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889216 00000100:00100000:2.0:1783951013.923743:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783951013.923757:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+20:6522:x1870607944889216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951013.923780:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951013.923807:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949600/0x7645c8e1169f82a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f82a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.923871:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949600/0x7645c8e1169f82a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f82a1 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.923884:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949600/0x7645c8e1169f82a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f82a1 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.923894:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949600, rc 0) 00000100:00100000:2.0:1783951013.924002:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944889216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (3408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.924011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783951013.924075:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951013.924109:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.924122:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951013.924287:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.924330:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.924371:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951013.924525:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889344 00000100:00100000:0.0:1783951013.924531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889344 00000100:00100000:0.0:1783951013.924587:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783951013.924597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944889344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951013.924752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944889344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951013.924759:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783951013.924809:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.924844:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.924891:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.924962:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951013.925118:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889472 00000100:00100000:0.0:1783951013.925123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889472 00000100:00100000:0.0:1783951013.925199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1783951013.925210:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944889472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951013.925335:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944889472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951013.925342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783951013.925632:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.926118:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13799:1870607944889600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.926199:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.926250:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.926541:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889600 00000100:00100000:2.0:1783951013.926548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889600 00000100:00100000:2.0:1783951013.926593:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1783951013.926603:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:13799:x1870607944889600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951013.926737:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+21:13799:x1870607944889600:12345-0@lo:502:llog_process_th.0 Request processed in 135us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.926745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783951013.927189:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13799:1870607944889600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951013.927222:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951013.927446:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.927450:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951013.927458:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0241aa4000 00000020:00000080:1.0:1783951013.927461:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951013.927598:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951013.927602:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.927604:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951013.927615:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951013.927618:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.927619:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951013.927621:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0241aa4000 00000020:00000080:1.0:1783951013.927623:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951013.934812:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13799:1870607944889728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.934928:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.934995:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951013.935109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889728 00000100:00100000:0.0:1783951013.935119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889728 00000100:00100000:0.0:1783951013.935216:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783951013.935240:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:13799:x1870607944889728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951013.935434:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+21:13799:x1870607944889728:12345-0@lo:502:llog_process_th.0 Request processed in 208us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951013.935451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783951013.935892:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13799:1870607944889728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951013.935928:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951013.935938:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.935940:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783951013.935944:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783951013.937631:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783951013.937676:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951013.937692:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.937707:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951013.937720:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951013.937723:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377952800 from 7 10000000:01000000:0.0:1783951013.937726:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951013.937773:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.937782:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951013.937793:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951013.937823:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951013.937908:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951013.937963:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.938186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889856 00000100:00100000:2.0:1783951013.938196:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889856 00000100:00100000:2.0:1783951013.938270:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1783951013.938294:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+21:6522:x1870607944889856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951013.938309:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951013.938326:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948600/0x7645c8e1169f82b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f82af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.938355:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948600/0x7645c8e1169f82b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f82af expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.938547:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948600/0x7645c8e1169f82b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f82af expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.938558:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948600, rc 0) 00000100:00100000:2.0:1783951013.938617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944889856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 326us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.938625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783951013.938852:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951013.938870:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.938880:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951013.938966:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.939118:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.939174:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951013.939234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944889984 00000100:00100000:0.0:1783951013.939239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944889984 00000100:00100000:0.0:1783951013.939486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1783951013.939497:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944889984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951013.939649:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944889984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951013.939666:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1783951013.939746:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944889984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.939779:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.939824:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.939855:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.939919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890112 00000100:00100000:2.0:1783951013.939923:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890112 00000100:00100000:2.0:1783951013.939957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1783951013.939964:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944890112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951013.940164:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944890112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.940172:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783951013.941196:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951013.942625:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13801:1870607944890240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951013.942722:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951013.942771:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.943111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890240 00000100:00100000:2.0:1783951013.943119:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890240 00000100:00100000:2.0:1783951013.943200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783951013.943211:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:13801:x1870607944890240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951013.944541:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:13801:x1870607944890240:12345-0@lo:502:llog_process_th.0 Request processed in 1324us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.944554:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783951013.944802:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13801:1870607944890240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951013.944846:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951013.944859:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951013.944862:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783951013.944870:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0377952800 00000020:00000080:0.0:1783951013.944873:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951013.944980:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951013.944984:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951013.944985:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783951013.944988:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951013.944991:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951013.944992:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783951013.944996:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0377952800 00000020:00000080:0.0:1783951013.944998:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783951013.946237:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13801:1870607944890368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951013.946571:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951013.948399:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951013.954581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890368 00000100:00100000:1.0:1783951013.954603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890368 00000100:00100000:1.0:1783951013.954741:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783951013.954754:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:13801:x1870607944890368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.955001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+22:13801:x1870607944890368:12345-0@lo:502:llog_process_th.0 Request processed in 249us (8429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951013.955023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1783951013.959716:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13801:1870607944890368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951013.959784:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951013.959797:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951013.959799:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783951013.959805:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783951013.964771:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783951013.964828:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951013.964844:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.964859:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951013.964872:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951013.964876:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 7 10000000:01000000:3.0:1783951013.964879:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951013.964930:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.964953:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.964967:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951013.966037:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951013.966132:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951013.966203:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03494e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.966699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890496 00000100:00100000:2.0:1783951013.966711:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890496 00000100:00100000:2.0:1783951013.966783:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783951013.966794:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+22:6522:x1870607944890496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951013.966833:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951013.966855:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948000/0x7645c8e1169f82c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f82bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.966887:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948000/0x7645c8e1169f82c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f82bd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.966899:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948000/0x7645c8e1169f82c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f82bd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.966910:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948000, rc 0) 00000100:00100000:2.0:1783951013.966963:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944890496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.966983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783951013.967270:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951013.967301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.967311:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951013.967628:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951013.967673:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951013.967716:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03494e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951013.967783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890624 00000100:00100000:1.0:1783951013.967790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890624 00000100:00100000:1.0:1783951013.967835:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783951013.967844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944890624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.968030:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944890624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951013.968037:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783951013.968072:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.968104:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.968181:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.968200:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951013.968215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890752 00000100:00100000:1.0:1783951013.968218:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890752 00000100:00100000:1.0:1783951013.968265:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783951013.968596:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944890752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.968692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944890752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 420us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951013.968705:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783951013.968745:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944890752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.968963:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13804:1870607944890880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.969721:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.969773:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951013.969850:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944890880 00000100:00100000:3.0:1783951013.969869:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944890880 00000100:00100000:3.0:1783951013.969922:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783951013.969931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:13804:x1870607944890880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951013.970074:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:13804:x1870607944890880:12345-0@lo:502:llog_process_th.0 Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951013.970082:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1783951013.970843:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13804:1870607944890880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951013.970885:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951013.970901:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.970904:0:13804:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951013.970912:0:13804:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0377b14000 00000020:00000080:1.0:1783951013.970916:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951013.971723:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951013.971735:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.971737:0:13804:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951013.971741:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951013.971745:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.971747:0:13804:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951013.971751:0:13804:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0377b14000 00000020:00000080:1.0:1783951013.971754:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1783951013.972841:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951013.976749:0:13804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13804:1870607944891008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.976859:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.976908:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891008 00000100:00100000:1.0:1783951013.976917:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891008 00000100:00100000:1.0:1783951013.976993:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1783951013.977004:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:13804:x1870607944891008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951013.977203:0:13804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951013.977735:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+23:13804:x1870607944891008:12345-0@lo:502:llog_process_th.0 Request processed in 731us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951013.977752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1783951013.977864:0:13804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247afa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13804:1870607944891008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951013.977900:0:13804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951013.977910:0:13804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951013.977912:0:13804:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783951013.977917:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783951013.978137:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783951013.978185:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951013.978199:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.978212:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951013.978224:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951013.978238:0:6522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db6000 from 7 10000000:01000000:1.0:1783951013.978242:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951013.978473:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.978483:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.978495:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951013.978519:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944891136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.978560:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.978596:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.978669:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891136 00000100:00100000:2.0:1783951013.978675:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891136 00000100:00100000:2.0:1783951013.978726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1783951013.978735:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+23:6522:x1870607944891136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951013.978746:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951013.978762:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f82d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f82cb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.978788:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f82d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f82cb expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.978799:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f82d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f82cb expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951013.978810:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949a00, rc 0) 00000100:00100000:2.0:1783951013.978855:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944891136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.978861:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783951013.979473:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944891136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951013.979492:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951013.979503:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951013.979585:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944891264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.979619:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.979656:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951013.979770:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891264 00000100:00100000:0.0:1783951013.979776:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891264 00000100:00100000:0.0:1783951013.979879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1783951013.979891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944891264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951013.980055:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944891264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951013.980062:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783951013.980128:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944891264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.980185:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944891392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.980237:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.984548:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00010000:00010000:1.0:1783951013.984630:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951013.987648:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891392 00000100:00100000:2.0:1783951013.987671:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891392 00000100:00100000:2.0:1783951013.988192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1783951013.988207:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944891392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951013.988635:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:6522:x1870607944891392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 431us (8405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.988645:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1783951013.988923:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1065061-5fe9-438e-843f-5f70939080ee:6522:1870607944891392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951013.990904:0:13806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13806:1870607944891520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.991005:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.991058:0:13806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951013.991117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891520 00000100:00100000:2.0:1783951013.991125:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891520 00000100:00100000:2.0:1783951013.991203:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1783951013.991214:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:13806:x1870607944891520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951013.992585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:13806:x1870607944891520:12345-0@lo:502:llog_process_th.0 Request processed in 1364us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951013.992599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1783951013.993515:0:13806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13806:1870607944891520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951013.993565:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951013.993578:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.993581:0:13806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951013.993589:0:13806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0343db6000 00000020:00000080:1.0:1783951013.993593:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951013.993676:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951013.993680:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.993682:0:13806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951013.993686:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951013.993689:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.993691:0:13806:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951013.993695:0:13806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0343db6000 00000020:00000080:1.0:1783951013.993704:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951013.993763:0:13806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13806:1870607944891648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.993834:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951013.993879:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891648 00000100:00100000:1.0:1783951013.993887:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891648 00000100:00100000:1.0:1783951013.993938:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1783951013.993950:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:13806:x1870607944891648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951013.994065:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:13806:x1870607944891648:12345-0@lo:502:llog_process_th.0 Request processed in 116us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951013.994074:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1783951013.994129:0:13806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951013.994174:0:13806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1065061-5fe9-438e-843f-5f70939080ee:13806:1870607944891648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951013.994191:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951013.994196:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951013.994199:0:13806:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783951013.994202:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783951013.996447:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783951013.996485:0:6522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951013.996500:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951013.996516:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951013.999705:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951014.146734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951014.147218:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833088 00000100:00100000:2.0:1783951014.147232:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833088 00000100:00100000:2.0:1783951014.147357:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 361 00000100:00100000:2.0:1783951014.147370:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:6181:x1870607923833088:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951014.147393:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951014.147417:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948200/0x7645c8e1169f82d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f562 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951014.147455:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948200/0x7645c8e1169f82d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f562 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951014.147490:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948200/0x7645c8e1169f82d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f562 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951014.147502:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948200, rc 0) 00000100:00100000:2.0:1783951014.147583:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923833088:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 215us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951014.147591:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 361 00000100:00100000:2.0:1783951014.156432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951014.156902:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833216 00000100:00100000:1.0:1783951014.156987:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833216 00000100:00100000:1.0:1783951014.157324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 362 00000100:00100000:1.0:1783951014.157338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923833216:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951014.157568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923833216:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 231us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951014.157577:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 362 00000100:00100000:0.0:1783951014.162667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951014.162779:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833344 00000100:00100000:2.0:1783951014.162800:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833344 00000100:00100000:2.0:1783951014.162864:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 363 00000100:00100000:2.0:1783951014.162873:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923833344:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951014.163083:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923833344:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 210us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951014.163090:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 363 00000100:00100000:3.0:1783951014.167624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951014.167740:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833472 00000100:00100000:1.0:1783951014.167753:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833472 00000100:00100000:1.0:1783951014.167881:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 364 00000100:00100000:1.0:1783951014.167925:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:10812:x1870607923833472:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951014.168137:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:10812:x1870607923833472:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 224us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951014.168167:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 364 00000100:00100000:3.0:1783951014.175951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951014.183866:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833600 00000100:00100000:2.0:1783951014.183890:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833600 00000100:00100000:2.0:1783951014.184211:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 365 00000100:00100000:2.0:1783951014.184227:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:10812:x1870607923833600:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951014.184696:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:10812:x1870607923833600:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 469us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951014.184706:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 365 00000100:00100000:3.0:1783951014.188775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951014.188849:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833728 00000100:00100000:2.0:1783951014.188861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833728 00000100:00100000:2.0:1783951014.188940:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 366 00000100:00100000:2.0:1783951014.188965:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:6181:x1870607923833728:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951014.188989:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951014.191616:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949000/0x7645c8e1169f82e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f569 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951014.191686:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949000/0x7645c8e1169f82e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f569 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951014.191703:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949000/0x7645c8e1169f82e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f569 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951014.191715:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949000, rc 0) 00000100:00100000:2.0:1783951014.195593:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923833728:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 6601us (6805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951014.195612:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 366 00000100:00100000:3.0:1783951014.197928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951014.198092:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833856 00000100:00100000:0.0:1783951014.198107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833856 00000100:00100000:0.0:1783951014.198222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 367 00000100:00100000:0.0:1783951014.198237:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923833856:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951014.198461:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923833856:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 227us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951014.198470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 367 00000100:00100000:0.0:1783951014.205580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951014.205677:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923833984 00000100:00100000:1.0:1783951014.205700:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923833984 00000100:00100000:1.0:1783951014.205792:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 368 00000100:00100000:1.0:1783951014.205804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923833984:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951014.206020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:6181:x1870607923833984:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 218us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951014.206029:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 368 00000100:00100000:1.0:1783951014.210521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951014.211055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834112 00000100:00100000:0.0:1783951014.211070:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834112 00000100:00100000:0.0:1783951014.211209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 369 00000100:00100000:0.0:1783951014.211224:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:10816:x1870607923834112:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951014.211471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:10816:x1870607923834112:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 251us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951014.211481:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 369 00000100:00100000:0.0:1783951014.225780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951014.225915:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834240 00000100:00100000:1.0:1783951014.225938:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834240 00000100:00100000:1.0:1783951014.226051:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 370 00000100:00100000:1.0:1783951014.226065:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:10816:x1870607923834240:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951014.226355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:10816:x1870607923834240:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 291us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951014.226364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 370 00000040:00080000:0.0:1783951015.010068:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951015.010868:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944891904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951015.010972:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951015.011063:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951015.011072:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944891776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951015.011112:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951015.011164:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891904 00000100:00100000:3.0:1783951015.011175:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891904 00000100:00100000:1.0:1783951015.011226:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944891776 00000100:00100000:1.0:1783951015.011229:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944891776 00000100:00100000:3.0:1783951015.011246:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783951015.011256:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944891904:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951015.011256:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783951015.011261:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944891776:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1783951015.011312:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1783951015.011312:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000040:00080000:2.0:1783951015.012134:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951015.012557:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944892032:0@lo:400:kworker.0 00000100:00100000:0.0:1783951015.012856:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944892288:0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.020495:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944891904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9224us (9507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951015.020517:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783951015.020581:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783951015.020598:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951015.020668:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944892416:0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.020748:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951015.020803:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944892928:0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.020833:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951015.020863:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944893440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951015.020888:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951015.020978:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944891904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951015.021048:0:6531:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783951015.021059:0:6531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783951015.021304:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893440 00000100:00100000:3.0:1783951015.021313:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893440 00000100:00100000:3.0:1783951015.021524:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783951015.021536:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944893440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951015.021566:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951015.021618:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944893440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951015.021626:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1783951015.021644:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951015.021676:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944893440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951015.021716:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892416 00000100:00100000:3.0:1783951015.021720:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892416 00000100:00100000:3.0:1783951015.021843:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783951015.021850:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944892416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.021894:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944892416:12345-0@lo:400:kworker.0 Request processed in 44us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951015.021901:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783951015.021925:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944892416:0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.021969:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892928 00000100:00100000:3.0:1783951015.021973:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892928 00000100:00100000:3.0:1783951015.022011:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783951015.022018:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944892928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.022056:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944892928:12345-0@lo:400:kworker.0 Request processed in 39us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951015.022070:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1783951015.022086:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951015.025543:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944891776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 14265us (14414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951015.025562:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783951015.025687:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944892160:0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.025788:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951015.025978:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944892672:0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.026005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951015.026029:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944893184:0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.026050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951015.026201:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892160 00000100:00100000:1.0:1783951015.026212:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892160 00000100:00100000:1.0:1783951015.026276:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892672 00000100:00100000:1.0:1783951015.026280:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892672 00000100:00100000:1.0:1783951015.026312:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893184 00000100:00100000:1.0:1783951015.026314:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893184 00000100:00100000:1.0:1783951015.026334:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783951015.026342:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944892160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.026605:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944892160:12345-0@lo:400:kworker.0 Request processed in 263us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951015.026612:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783951015.026629:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783951015.026980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951015.027011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892032 00000100:00100000:2.0:1783951015.027015:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892032 00000100:00100000:2.0:1783951015.027055:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1783951015.027063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944892032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.027185:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944892672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.027240:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944892672:12345-0@lo:400:kworker.0 Request processed in 605us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951015.027248:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783951015.027261:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783951015.027280:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944893184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.027311:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944893184:12345-0@lo:400:kworker.0 Request processed in 45us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951015.027317:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783951015.027445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944892032:12345-0@lo:400:kworker.0 Request processed in 383us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951015.027451:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1783951015.027514:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944892032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.027536:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944892544:0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.027564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951015.027955:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944893056:0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.027982:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951015.028190:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892544 00000100:00100000:1.0:1783951015.028198:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892544 00000100:00100000:1.0:1783951015.028236:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893056 00000100:00100000:1.0:1783951015.028239:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893056 00000100:00100000:1.0:1783951015.028255:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783951015.028263:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944892544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.028323:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944892544:12345-0@lo:400:kworker.0 Request processed in 60us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951015.028330:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783951015.028463:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783951015.028473:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944893056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.028505:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944893056:12345-0@lo:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00080000:0.0:1783951015.028556:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951015.028562:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951015.028575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951015.028603:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892288 00000100:00100000:0.0:1783951015.028607:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892288 00010000:00080000:3.0:1783951015.028671:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc6a300 x1870607944892928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951015.028689:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944892928:0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.028697:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944892544:0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.028707:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944893056:0@lo:400:kworker.0 00000100:00100000:3.0:1783951015.028717:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944891776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951015.028860:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783951015.028898:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944892160:0@lo:400:kworker.0 00010000:00080000:1.0:1783951015.028912:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248160700 x1870607944892672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951015.028940:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944892672:0@lo:400:kworker.0 00010000:00080000:1.0:1783951015.028955:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc6aa00 x1870607944893184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951015.028963:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944893184:0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.029006:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944892800:0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.029038:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951015.029063:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944893312:0@lo:400:kworker.0 00000100:00100000:1.0:1783951015.029083:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951015.029299:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944892800 00000100:00100000:2.0:1783951015.029304:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944892800 00000100:00100000:2.0:1783951015.029467:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893312 00000100:00100000:2.0:1783951015.029471:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893312 00000100:00100000:2.0:1783951015.029491:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783951015.029498:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944892800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.029545:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944892800:12345-0@lo:400:kworker.0 Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951015.029551:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783951015.029565:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783951015.029572:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944893312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951015.029598:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944893312:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951015.029604:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783951015.029788:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783951015.029801:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944892288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951015.029839:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944892288:12345-0@lo:400:kworker.0 Request processed in 43us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951015.029846:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783951015.029893:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944892288:0@lo:400:kworker.0 00010000:00080000:0.0:1783951015.029904:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc68380 x1870607944892800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951015.029913:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944892800:0@lo:400:kworker.0 00000100:00100000:0.0:1783951015.029921:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944893312:0@lo:400:kworker.0 00000100:00080000:1.0:1783951015.030073:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951016.034376:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951016.706586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951016.706654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951016.706656:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834496 00000100:00100000:1.0:1783951016.706670:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834496 00000100:00100000:3.0:1783951016.706698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951016.706739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951016.706767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951016.706796:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951016.706810:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834624 00000100:00100000:1.0:1783951016.706815:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834624 00000100:00100000:3.0:1783951016.706827:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834880 00000100:00100000:3.0:1783951016.706833:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834880 00000100:00100000:2.0:1783951016.706878:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834752 00000100:00100000:2.0:1783951016.706883:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834752 00000100:00080000:0.0:1783951016.706977:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951016.706984:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951016.706986:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951016.706999:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835008 00000100:00100000:0.0:1783951016.707019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835008 00000100:00100000:0.0:1783951016.707075:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 225 00000100:00100000:0.0:1783951016.707089:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923834496:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951016.707168:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 226 00000100:00100000:1.0:1783951016.707178:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923835008:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951016.707217:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 227 00000100:00100000:3.0:1783951016.707226:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923834624:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951016.707321:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923835008:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 144us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951016.707330:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 226 00000100:00100000:3.0:1783951016.707364:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923834624:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 138us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951016.707372:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 228 00000100:00100000:3.0:1783951016.707383:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 227 00000100:00100000:0.0:1783951016.707439:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923834496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 353us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951016.707447:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 225 00000100:00080000:0.0:1783951016.707465:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951016.707491:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923834368 00000100:00100000:0.0:1783951016.707496:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923834368 00000100:00100000:0.0:1783951016.707534:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 372 00000100:00100000:0.0:1783951016.707542:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923834368:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951016.707570:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923834368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951016.707577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 372 00000100:00100000:1.0:1783951016.707714:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923834880:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951016.707743:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923834880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 363us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951016.707749:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 228 00000100:00100000:2.0:1783951016.708196:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:2.0:1783951016.708205:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e90a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923834752:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951016.708271:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e90a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923834752:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 67us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951016.708278:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:1.0:1783951017.057268:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951017.057298:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944893568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951017.057396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951017.057633:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893568 00000100:00100000:2.0:1783951017.057643:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893568 00000100:00100000:2.0:1783951017.057706:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783951017.057717:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944893568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951017.057767:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783951017.057836:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944893568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951017.057844:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:0.0:1783951017.057912:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951017.059612:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944893568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951017.569664:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944893696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951017.569771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951017.569845:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893696 00000100:00100000:3.0:1783951017.569859:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893696 00000100:00100000:3.0:1783951017.569950:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783951017.569964:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944893696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951017.570009:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951017.570085:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944893696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951017.570112:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1783951017.570257:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e4000 x1870607944893696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951017.570281:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944893696:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951017.571485:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783951018.081832:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951018.082255:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951018.082283:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944893824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951018.082379:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951018.082470:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893824 00000100:00100000:3.0:1783951018.082479:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893824 00000100:00100000:3.0:1783951018.082548:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783951018.082558:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944893824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951018.082590:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951018.082639:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944893824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951018.082647:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1783951018.082691:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248017b80 x1870607944893824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951018.082713:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944893824:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783951018.083034:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951019.105937:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783951019.107377:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1783951020.128507:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944893952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951020.128604:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.128784:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944893952 00000100:00100000:3.0:1783951020.128793:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944893952 00000100:00100000:3.0:1783951020.128861:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783951020.128871:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944893952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951020.128924:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783951020.128975:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944893952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.128983:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783951020.129030:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944893952:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783951020.129404:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951020.129516:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944894080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951020.129563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.129588:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894080 00000100:00100000:3.0:1783951020.129592:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894080 00000100:00100000:0.0:1783951020.135864:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944894208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951020.135933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951020.136024:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894208 00000100:00100000:0.0:1783951020.136031:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894208 00000100:00100000:3.0:1783951020.140517:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783951020.140535:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944894080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951020.140575:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951020.140658:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944894080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (11094us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.140666:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783951020.140846:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944894464:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.140883:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.141719:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944894976:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.141752:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.141782:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944895488:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.141804:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.141826:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951020.141833:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944894336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.141859:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.141881:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944894848:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.141901:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.141933:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944895360:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.141956:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951020.141986:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894464 00000100:00100000:3.0:1783951020.141992:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894464 00000100:00100000:3.0:1783951020.142022:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894976 00000100:00100000:3.0:1783951020.142037:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894976 00000100:00100000:2.0:1783951020.142366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894336 00000100:00100000:2.0:1783951020.142371:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894336 00000100:00100000:2.0:1783951020.142401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1783951020.142409:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944894336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951020.142457:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944894336:12345-0@lo:400:kworker.0 Request processed in 48us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951020.142464:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1783951020.142495:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895488 00000100:00100000:2.0:1783951020.142498:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895488 00000100:00100000:1.0:1783951020.144408:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944894592:0@lo:400:kworker.0 00000100:00100000:1.0:1783951020.144482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951020.144512:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944895104:0@lo:400:kworker.0 00000100:00100000:1.0:1783951020.144540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951020.144585:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1783951020.144591:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0341219880, transno 4294967301 00000100:00100000:1.0:1783951020.144614:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944894080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951020.144651:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951020.144658:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944894720:0@lo:400:kworker.0 00000100:00100000:1.0:1783951020.144686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951020.144705:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944895232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951020.144725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951020.145102:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783951020.145116:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944894208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951020.145139:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951020.145878:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944894208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (9286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951020.145888:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783951020.145946:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944894208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951020.148079:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894848 00000100:00100000:3.0:1783951020.148091:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894848 00000100:00100000:3.0:1783951020.148113:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895360 00000100:00100000:3.0:1783951020.148115:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895360 00000100:00100000:3.0:1783951020.148132:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894592 00000100:00100000:3.0:1783951020.148135:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894592 00000100:00100000:3.0:1783951020.148169:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783951020.148178:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944894464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148300:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944894464:12345-0@lo:400:kworker.0 Request processed in 122us (7416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148308:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783951020.148325:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783951020.148332:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148364:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944894976:12345-0@lo:400:kworker.0 Request processed in 33us (6611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148370:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783951020.148381:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783951020.148387:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944894848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148416:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944894848:12345-0@lo:400:kworker.0 Request processed in 29us (6514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148422:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783951020.148433:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783951020.148439:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944895360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148467:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944895360:12345-0@lo:400:kworker.0 Request processed in 28us (6510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148473:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783951020.148499:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783951020.148505:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944894592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148553:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944894592:12345-0@lo:400:kworker.0 Request processed in 48us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148559:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783951020.148588:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895104 00000100:00100000:3.0:1783951020.148592:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895104 00000100:00100000:3.0:1783951020.148622:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895232 00000100:00100000:3.0:1783951020.148625:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895232 00000100:00100000:3.0:1783951020.148643:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783951020.148649:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944895104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148682:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944895104:12345-0@lo:400:kworker.0 Request processed in 32us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148687:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783951020.148697:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783951020.148703:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944895232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148732:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944895232:12345-0@lo:400:kworker.0 Request processed in 28us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148737:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783951020.148781:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944894720 00000100:00100000:3.0:1783951020.148785:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944894720 00000100:00100000:3.0:1783951020.148808:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783951020.148813:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944894720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.148845:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944894720:12345-0@lo:400:kworker.0 Request processed in 32us (4159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951020.148851:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783951020.148967:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783951020.148976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944895488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951020.149032:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944895488:12345-0@lo:400:kworker.0 Request processed in 57us (7226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951020.149038:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1783951020.149297:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951020.149302:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951020.149305:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951020.149307:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951020.149343:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944894720:0@lo:400:kworker.0 00010000:00080000:1.0:1783951020.152279:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03412a8e00 x1870607944895232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951020.152299:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944895232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951020.152338:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944894592:0@lo:400:kworker.0 00010000:00080000:1.0:1783951020.152361:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03412a9f80 x1870607944895104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951020.152370:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944895104:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.152785:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944894336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.152823:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944894848:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.152837:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944895360:0@lo:400:kworker.0 00000100:00100000:3.0:1783951020.152849:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944894464:0@lo:400:kworker.0 00010000:00080000:3.0:1783951020.152860:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03412a9500 x1870607944894976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951020.152869:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944894976:0@lo:400:kworker.0 00010000:00080000:3.0:1783951020.152881:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbcc700 x1870607944895488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951020.152887:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944895488:0@lo:400:kworker.0 00010000:00010000:0.0:1783951021.152624:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951021.826354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951021.826402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951021.826437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951021.826471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951021.826499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951021.826521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951021.826551:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835392 00000100:00100000:3.0:1783951021.826560:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835392 00000100:00100000:3.0:1783951021.826616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835648 00000100:00100000:3.0:1783951021.826619:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835648 00000100:00100000:3.0:1783951021.826632:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835264 00000100:00100000:3.0:1783951021.826634:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835264 00000100:00100000:3.0:1783951021.826651:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835776 00000100:00100000:3.0:1783951021.826653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835776 00000100:00100000:3.0:1783951021.826669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 235 00000100:00100000:3.0:1783951021.826690:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923835392:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951021.826797:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923835392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 108us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951021.826805:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 235 00000100:00100000:3.0:1783951021.826823:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 236 00000100:00100000:3.0:1783951021.826830:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923835648:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951021.826855:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923835648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951021.826860:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 236 00000100:00100000:3.0:1783951021.826871:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 237 00000100:00100000:3.0:1783951021.826876:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923835264:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951021.826897:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923835264:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951021.826902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 237 00000100:00100000:3.0:1783951021.826914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 238 00000100:00100000:3.0:1783951021.826919:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923835776:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951021.826937:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923835776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 19us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951021.826942:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 238 00000100:00100000:3.0:1783951021.826958:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835520 00000100:00100000:3.0:1783951021.826961:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835520 00000100:00100000:3.0:1783951021.827003:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 91 00000100:00100000:3.0:1783951021.827010:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923835520:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951021.827034:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923835520:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951021.827046:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 91 00000100:00080000:1.0:1783951021.827555:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951021.827561:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951021.827564:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951021.827713:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835136 00000100:00100000:0.0:1783951021.827718:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835136 00000100:00100000:0.0:1783951021.827776:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 374 00000100:00100000:0.0:1783951021.827786:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923835136:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951021.827832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923835136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 48us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951021.827838:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 374 00010000:00010000:0.0:1783951022.176660:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951022.177841:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944895616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951022.177948:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951022.178633:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895616 00000100:00100000:2.0:1783951022.178646:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895616 00000100:00100000:2.0:1783951022.178722:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783951022.178736:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944895616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951022.178798:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783951022.178878:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944895616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951022.178886:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783951022.178949:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944895616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951022.688904:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951022.688931:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944895744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951022.689019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951022.689259:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895744 00000100:00100000:0.0:1783951022.689268:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895744 00000100:00100000:0.0:1783951022.689331:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783951022.689359:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944895744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951022.689398:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951022.689464:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944895744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951022.689472:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1783951022.689529:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783951022.689584:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e4e00 x1870607944895744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951022.689611:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944895744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951023.200969:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944895872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951023.201078:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951023.202226:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951023.204012:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944895872 00000100:00100000:0.0:1783951023.204034:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944895872 00000100:00100000:0.0:1783951023.204584:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783951023.204623:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944895872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951023.204865:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783951023.206570:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951023.210539:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944895872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5926us (9444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951023.210561:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1783951023.210959:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbcca80 x1870607944895872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951023.211070:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944895872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951024.224399:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951025.248518:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944896000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951025.248622:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951025.248759:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896000 00000100:00100000:3.0:1783951025.248769:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896000 00000100:00100000:3.0:1783951025.248836:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783951025.248848:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944896000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951025.248891:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951025.248954:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944896000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951025.248962:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1783951025.248989:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951025.249053:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944896000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951025.249504:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944896128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951025.249544:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783951025.249548:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951025.249566:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944896640:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249593:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951025.249614:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944897152:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951025.249674:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944896384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249676:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944897664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.249713:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944896512:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951025.249734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951025.249744:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783951025.249747:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951025.249750:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944896256:0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.249766:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944897024:0@lo:400:kworker.0 00000100:00100000:1.0:1783951025.249783:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944896896:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951025.249819:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944896768:0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.249820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951025.249847:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944897536:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249852:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951025.249870:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951025.249870:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944897280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.249896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951025.249900:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896128 00000100:00100000:2.0:1783951025.249905:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896128 00000100:00100000:0.0:1783951025.249910:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951025.249917:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944897792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951025.249931:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896512 00000100:00100000:2.0:1783951025.249934:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896512 00000100:00100000:2.0:1783951025.249943:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896768 00000100:00100000:2.0:1783951025.249945:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896768 00000100:00100000:0.0:1783951025.249955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951025.249958:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783951025.249965:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944896128:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951025.249989:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000004:00000024:2.0:1783951025.249996:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783951025.250013:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944896512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.250037:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944896128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250043:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783951025.250056:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944896512:12345-0@lo:400:kworker.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250057:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783951025.250063:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944896768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951025.250063:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783951025.250082:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896640 00000100:00100000:0.0:1783951025.250085:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896640 00000100:00100000:2.0:1783951025.250090:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944896768:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250096:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783951025.250115:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896384 00000100:00100000:0.0:1783951025.250323:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896384 00000100:00100000:2.0:1783951025.250376:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897024 00000100:00100000:2.0:1783951025.250381:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897024 00000100:00100000:2.0:1783951025.250408:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897536 00000100:00100000:2.0:1783951025.250412:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897536 00000100:00100000:2.0:1783951025.250427:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783951025.250432:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944896640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.250466:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944896640:12345-0@lo:400:kworker.0 Request processed in 34us (872us total) trans 0 rc 0/0 00000040:00080000:1.0:1783951025.250473:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951025.250485:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783951025.250522:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944896512:0@lo:400:kworker.0 00000100:00080000:3.0:1783951025.250549:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951025.250576:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897152 00000100:00100000:3.0:1783951025.250580:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897152 00000100:00100000:3.0:1783951025.250617:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897664 00000100:00100000:3.0:1783951025.250619:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897664 00000100:00100000:3.0:1783951025.250633:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897280 00000100:00100000:3.0:1783951025.250635:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897280 00000100:00100000:3.0:1783951025.250651:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783951025.250657:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944897152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.250657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783951025.250662:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944896384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.250691:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944897152:12345-0@lo:400:kworker.0 Request processed in 34us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250691:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944896384:12345-0@lo:400:kworker.0 Request processed in 28us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250697:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1783951025.250707:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783951025.250708:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783951025.250714:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944897024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.250718:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783951025.250723:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944897664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.250747:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944897024:12345-0@lo:400:kworker.0 Request processed in 33us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951025.250751:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944897664:12345-0@lo:400:kworker.0 Request processed in 28us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250753:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1783951025.250757:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783951025.250764:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783951025.250765:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783951025.250770:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944897280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.250770:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944897536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.250794:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944897536:12345-0@lo:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951025.250795:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944897280:12345-0@lo:400:kworker.0 Request processed in 24us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951025.250801:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783951025.250801:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783951025.250825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896256 00000100:00100000:3.0:1783951025.250828:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896256 00010000:00080000:2.0:1783951025.250828:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc65c00 x1870607944897024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951025.250839:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944897024:0@lo:400:kworker.0 00010000:00080000:2.0:1783951025.250849:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc67b80 x1870607944897536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951025.250854:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1783951025.250858:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944897536:0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.250860:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944896256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.250890:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944896256:12345-0@lo:400:kworker.0 Request processed in 31us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951025.250897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1783951025.250899:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897792 00000100:00100000:2.0:1783951025.250908:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897792 00000100:00080000:3.0:1783951025.250924:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951025.250927:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951025.250931:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783951025.250937:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944897792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951025.250952:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951025.250984:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951025.250984:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944897792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.250990:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783951025.251004:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944896896 00000100:00100000:3.0:1783951025.251006:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944897408:0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.251007:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944896896 00000100:00100000:3.0:1783951025.251030:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951025.251030:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783951025.251036:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944896896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.251056:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944896384:0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.251064:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944896896:12345-0@lo:400:kworker.0 Request processed in 29us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951025.251066:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944896896:0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.251070:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783951025.251079:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897408 00000100:00100000:2.0:1783951025.251082:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897408 00000100:00080000:3.0:1783951025.251097:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951025.251108:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1783951025.251113:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944897408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951025.251167:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944897408:12345-0@lo:400:kworker.0 Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951025.251185:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1783951025.251211:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944897408:0@lo:400:kworker.0 00010000:00010000:1.0:1783951025.251340:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951025.252082:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944897792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951025.252094:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944896256:0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.252105:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944896768:0@lo:400:kworker.0 00010000:00080000:3.0:1783951025.252117:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc67800 x1870607944897280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951025.252911:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944897280:0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.253080:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944896128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951025.253096:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944896640:0@lo:400:kworker.0 00010000:00080000:3.0:1783951025.253109:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc65880 x1870607944897152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951025.253119:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944897152:0@lo:400:kworker.0 00000100:00100000:3.0:1783951025.258824:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944897664:0@lo:400:kworker.0 00010000:00010000:1.0:1783951026.272475:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951026.946508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951026.946655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951026.946714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951026.946807:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836288 00000100:00100000:0.0:1783951026.946822:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836288 00000100:00100000:0.0:1783951026.946924:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 95 00000100:00100000:0.0:1783951026.946957:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923836288:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951026.947079:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923836288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 144us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951026.947087:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 95 00000100:00080000:2.0:1783951026.948278:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951026.953837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951026.953951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951026.957641:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836032 00000100:00100000:3.0:1783951026.957662:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836032 00000100:00100000:3.0:1783951026.958005:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836544 00000100:00100000:3.0:1783951026.958010:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836544 00000100:00100000:3.0:1783951026.958192:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 245 00000100:00100000:3.0:1783951026.958211:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923836032:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951026.958405:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923836032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 200us (11917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951026.958414:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 245 00000100:00100000:3.0:1783951026.958460:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 246 00000100:00100000:3.0:1783951026.958467:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923836544:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951026.958495:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923836544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (11781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951026.958501:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 246 00000100:00080000:3.0:1783951026.958554:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951026.958559:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951026.958834:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923835904 00000100:00100000:0.0:1783951026.958841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923835904 00000100:00100000:0.0:1783951026.958907:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 376 00000100:00100000:0.0:1783951026.958917:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923835904:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951026.958951:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2408:x1870607923835904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 38us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951026.958958:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 376 00000100:00100000:1.0:1783951026.962215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951026.962468:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836160 00000100:00100000:2.0:1783951026.962481:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836160 00000100:00100000:2.0:1783951026.962595:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836416 00000100:00100000:2.0:1783951026.962599:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836416 00000100:00100000:2.0:1783951026.962655:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 247 00000100:00100000:2.0:1783951026.962668:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923836160:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951026.962789:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923836160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 123us (8836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951026.962798:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 247 00000100:00100000:2.0:1783951026.962819:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 248 00000100:00100000:2.0:1783951026.962826:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923836416:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951026.962860:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923836416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 34us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951026.962867:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 248 00000100:00080000:1.0:1783951026.963994:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951026.964003:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951027.298355:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944897920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951027.298459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783951027.298809:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951027.298829:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944897920 00000100:00100000:0.0:1783951027.298839:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944897920 00000100:00100000:0.0:1783951027.298927:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783951027.298940:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944897920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951027.298991:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783951027.299080:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944897920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951027.299088:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783951027.299186:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944897920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951027.809536:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951027.809573:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944898048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951027.809678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951027.810456:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898048 00000100:00100000:3.0:1783951027.810472:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898048 00000100:00100000:3.0:1783951027.810567:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783951027.810580:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944898048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951027.810628:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951027.810698:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944898048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951027.810707:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1783951027.810895:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783951027.811070:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03811b8e00 x1870607944898048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951027.811096:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944898048:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783951028.320481:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951028.321980:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944898176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951028.322083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951028.327235:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898176 00000100:00100000:0.0:1783951028.327259:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898176 00000100:00100000:0.0:1783951028.327385:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951028.327421:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944898176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951028.327462:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951028.327606:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944898176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (5522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951028.327616:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1783951028.328071:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951028.328205:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbcd500 x1870607944898176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951028.328235:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944898176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951029.345220:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951030.368447:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951030.368481:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944898304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951030.368578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951030.368890:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898304 00000100:00100000:0.0:1783951030.368899:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898304 00000100:00100000:0.0:1783951030.368979:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783951030.369011:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944898304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951030.369069:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951030.369164:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944898304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951030.369172:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783951030.369232:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944898304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951030.377197:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944898688:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.377305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951030.377371:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944899200:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.377397:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951030.377437:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951030.377441:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944899712:0@lo:400:kworker.0 00000100:00080000:1.0:1783951030.377450:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951030.377466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377467:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944898432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951030.377493:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783951030.377499:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944898816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.377504:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951030.377518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377526:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944898944:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.377531:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944899328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.377547:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951030.377568:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898432 00000100:00100000:1.0:1783951030.377569:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944899456:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.377579:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898432 00000100:00100000:1.0:1783951030.377594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377610:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944899968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.377629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377653:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783951030.377654:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783951030.377657:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944898560:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.377666:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944898432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951030.377695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1783951030.377716:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783951030.377717:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944899072:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.377736:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377746:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944899584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.377766:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377784:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944900096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951030.377810:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.377842:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898816 00000100:00100000:1.0:1783951030.377846:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898816 00000100:00100000:1.0:1783951030.377867:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899072 00000100:00100000:1.0:1783951030.377870:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899072 00000100:00100000:1.0:1783951030.377884:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951030.377890:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944898816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.377938:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944898816:12345-0@lo:400:kworker.0 Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.377947:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951030.377965:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783951030.377972:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944899072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378007:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944899072:12345-0@lo:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.378014:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783951030.378033:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898688 00000100:00100000:1.0:1783951030.378037:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898688 00000100:00100000:1.0:1783951030.378059:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899200 00000100:00100000:1.0:1783951030.378062:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899200 00000100:00100000:1.0:1783951030.378083:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899712 00000100:00100000:1.0:1783951030.378086:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899712 00000100:00100000:1.0:1783951030.378111:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898944 00000100:00100000:1.0:1783951030.378114:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898944 00000100:00100000:0.0:1783951030.378120:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944898432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 457us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951030.378160:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783951030.378162:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783951030.378168:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944898688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378197:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899456 00000100:00100000:1.0:1783951030.378200:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944898688:12345-0@lo:400:kworker.0 Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951030.378201:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899456 00000100:00100000:1.0:1783951030.378206:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783951030.378217:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783951030.378223:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944899200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378229:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899968 00000100:00100000:0.0:1783951030.378232:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899968 00000100:00100000:0.0:1783951030.378248:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899584 00000100:00100000:1.0:1783951030.378250:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944899200:12345-0@lo:400:kworker.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951030.378250:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899584 00000100:00100000:1.0:1783951030.378256:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783951030.378263:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783951030.378264:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783951030.378269:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378270:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944899456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378295:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944899712:12345-0@lo:400:kworker.0 Request processed in 25us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951030.378295:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944899456:12345-0@lo:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.378302:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783951030.378302:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783951030.378312:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783951030.378312:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783951030.378318:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944898944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378320:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944899968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378343:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944898944:12345-0@lo:400:kworker.0 Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.378350:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783951030.378352:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944899968:12345-0@lo:400:kworker.0 Request processed in 35us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951030.378358:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1783951030.378364:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951030.378367:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951030.378368:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1783951030.378370:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951030.378376:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944899584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378381:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900096 00000100:00100000:1.0:1783951030.378384:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900096 00000100:00100000:0.0:1783951030.378404:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944899584:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.378410:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783951030.378410:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783951030.378415:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944900096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951030.378431:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951030.378434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951030.378454:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944899840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378462:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944900096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.378468:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783951030.378477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951030.378483:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899328 00000100:00100000:1.0:1783951030.378486:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899328 00000100:00100000:1.0:1783951030.378504:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944899840 00000100:00100000:1.0:1783951030.378507:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944899840 00000100:00100000:0.0:1783951030.378510:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944898688:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378518:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783951030.378524:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944899328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378524:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944899200:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378534:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944899712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378550:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944899328:12345-0@lo:400:kworker.0 Request processed in 27us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951030.378556:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783951030.378558:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944898816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378567:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00010000:00080000:0.0:1783951030.378570:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e4e00 x1870607944899328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951030.378573:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944899840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378581:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944899328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951030.378597:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944899840:12345-0@lo:400:kworker.0 Request processed in 24us (118us total) trans 0 rc 0/0 00010000:00080000:0.0:1783951030.378597:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0e680 x1870607944899840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951030.378603:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783951030.378606:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944899840:0@lo:400:kworker.0 00000100:00080000:1.0:1783951030.378615:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951030.378635:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944899072:0@lo:400:kworker.0 00010000:00080000:0.0:1783951030.378671:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0f480 x1870607944899584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951030.378689:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944899584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378709:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944900096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951030.378721:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944898432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951030.378730:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944898944:0@lo:400:kworker.0 00010000:00080000:0.0:1783951030.378739:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0fb80 x1870607944899456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951030.378761:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944899456:0@lo:400:kworker.0 00000100:00100000:0.0:1783951030.378771:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944899968:0@lo:400:kworker.0 00000100:00100000:2.0:1783951030.379290:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944898560 00000100:00100000:2.0:1783951030.379296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944898560 00000100:00100000:2.0:1783951030.379331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1783951030.379338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944898560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951030.379392:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944898560:12345-0@lo:400:kworker.0 Request processed in 55us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951030.379399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1783951030.379521:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944898560:0@lo:400:kworker.0 00010000:00010000:1.0:1783951031.393043:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951032.066999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951032.067138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951032.067231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951032.067381:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836928 00000100:00100000:2.0:1783951032.067393:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836928 00000100:00100000:2.0:1783951032.067491:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836800 00000100:00100000:2.0:1783951032.067495:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836800 00000100:00100000:2.0:1783951032.067528:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 255 00000100:00100000:2.0:1783951032.067542:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923836928:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951032.067660:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923836928:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 121us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951032.067669:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 255 00000100:00100000:2.0:1783951032.067689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 256 00000100:00100000:2.0:1783951032.067696:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923836800:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951032.067726:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923836800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951032.067733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 256 00000100:00080000:0.0:1783951032.068429:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951032.068436:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951032.068656:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923836672 00000100:00100000:3.0:1783951032.068663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923836672 00000100:00100000:3.0:1783951032.068714:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 378 00000100:00100000:3.0:1783951032.068734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923836672:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951032.068873:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923836672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 141us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951032.068880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 378 00000100:00100000:0.0:1783951032.080687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951032.083741:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837056 00000100:00100000:2.0:1783951032.083765:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837056 00000100:00100000:2.0:1783951032.083995:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:2.0:1783951032.084010:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2406:x1870607923837056:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:2.0:1783951032.084057:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f8207 00000100:00080000:2.0:1783951032.084072:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e0248053000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951032.084182:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1783951032.084422:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+2:2406:x1870607923837056:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 415us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951032.084432:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00010000:00010000:1.0:1783951032.085969:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951032.086685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951032.086814:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837184 00000100:00100000:3.0:1783951032.086826:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837184 00000100:00080000:0.0:1783951032.090400:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951032.090417:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951032.093932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951032.096561:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837312 00000100:00100000:3.0:1783951032.096583:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837312 00000100:00100000:2.0:1783951032.096677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 257 00000100:00100000:2.0:1783951032.096695:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923837184:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951032.096786:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 258 00000100:00100000:1.0:1783951032.096797:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923837312:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951032.096808:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:2408:x1870607923837184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (10132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951032.096820:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 257 00000100:00100000:1.0:1783951032.096857:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923837312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 62us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951032.096866:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 258 00000100:00080000:3.0:1783951032.097076:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783951032.416487:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951032.416555:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944900224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951032.416647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951032.416958:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900224 00000100:00100000:3.0:1783951032.416969:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900224 00000100:00100000:3.0:1783951032.417035:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783951032.417046:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944900224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951032.417095:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783951032.417188:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944900224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951032.417197:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783951032.417285:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944900224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951032.929540:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944900352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951032.929648:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951032.929972:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900352 00000100:00100000:1.0:1783951032.929983:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900352 00000100:00100000:1.0:1783951032.930129:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783951032.930162:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944900352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951032.930213:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951032.930278:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944900352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951032.930287:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1783951032.930374:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a4d500 x1870607944900352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951032.930416:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944900352:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951032.930623:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951033.440966:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944900480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951033.441055:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951033.441112:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900480 00000100:00100000:2.0:1783951033.441123:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900480 00000100:00080000:0.0:1783951033.441200:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951033.441236:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783951033.441249:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944900480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951033.441542:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951033.441613:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944900480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 366us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951033.441623:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1783951033.441667:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc6b100 x1870607944900480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951033.441691:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944900480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951033.442357:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951034.466465:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951035.488332:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944900608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951035.488370:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944900736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951035.488408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.488408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783951035.489290:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783951035.490845:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951035.491276:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944900864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951035.491421:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944901120:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.491468:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.491495:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944901632:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.491518:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.491538:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944902144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.491561:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.491580:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783951035.491586:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944900992:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.491624:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.491646:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944901504:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.491671:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.491690:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944902016:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.491714:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.491760:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900608 00000100:00100000:2.0:1783951035.491767:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900608 00000100:00100000:2.0:1783951035.491811:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901504 00000100:00100000:2.0:1783951035.491815:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901504 00000100:00100000:2.0:1783951035.491832:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783951035.491840:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944900608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951035.491893:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783951035.491942:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944900608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.491949:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783951035.491968:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783951035.491975:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944901504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492005:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944901504:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492012:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783951035.492031:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901120 00000100:00100000:2.0:1783951035.492035:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901120 00000100:00100000:2.0:1783951035.492059:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901632 00000100:00100000:2.0:1783951035.492062:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901632 00000100:00100000:2.0:1783951035.492096:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902144 00000100:00100000:2.0:1783951035.492099:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902144 00000100:00100000:2.0:1783951035.492115:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783951035.492120:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944901120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951035.492135:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944901248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492163:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944901120:12345-0@lo:400:kworker.0 Request processed in 42us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492169:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783951035.492173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.492181:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783951035.492187:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944901632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951035.492190:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944901760:0@lo:400:kworker.0 00000100:00100000:3.0:1783951035.492211:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.492216:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944901632:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951035.492220:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944902272:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492222:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783951035.492231:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901760 00000100:00100000:2.0:1783951035.492234:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901760 00000100:00100000:3.0:1783951035.492239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951035.492247:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902272 00000100:00100000:2.0:1783951035.492249:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902272 00000100:00100000:2.0:1783951035.492260:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783951035.492265:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944902144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492290:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944902144:12345-0@lo:400:kworker.0 Request processed in 24us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492296:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783951035.492306:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783951035.492312:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944901760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492351:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944901760:12345-0@lo:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492357:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783951035.492369:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783951035.492376:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944902272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492402:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944902272:12345-0@lo:400:kworker.0 Request processed in 27us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492407:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00080000:3.0:1783951035.492418:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0f480 x1870607944901760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951035.492432:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900992 00000100:00100000:3.0:1783951035.492433:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944901760:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900992 00010000:00080000:3.0:1783951035.492444:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03810e6680 x1870607944902272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951035.492452:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944902272:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492456:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1783951035.492461:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944900992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492498:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944900992:12345-0@lo:400:kworker.0 Request processed in 36us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492505:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1783951035.492531:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901248 00000100:00100000:2.0:1783951035.492535:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901248 00000100:00100000:2.0:1783951035.492550:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783951035.492555:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944901248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492598:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944901248:12345-0@lo:400:kworker.0 Request processed in 41us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492603:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783951035.492622:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902016 00000100:00100000:2.0:1783951035.492626:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902016 00000100:00100000:2.0:1783951035.492654:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783951035.492661:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944902016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951035.492686:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944901248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492691:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944902016:12345-0@lo:400:kworker.0 Request processed in 31us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.492696:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1783951035.492719:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951035.492724:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951035.492726:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951035.492755:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944900992:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492766:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944901504:0@lo:400:kworker.0 00010000:00080000:2.0:1783951035.492775:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0e300 x1870607944902016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951035.492784:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944902016:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492806:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944901120:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492817:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944901632:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492827:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944902144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.492843:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944900608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951035.495804:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900736 00000100:00100000:2.0:1783951035.495819:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900736 00000100:00100000:2.0:1783951035.495941:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783951035.495953:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944900736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951035.495988:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951035.496074:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944900736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.496090:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783951035.496533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951035.496579:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944901376:0@lo:400:kworker.0 00000100:00100000:0.0:1783951035.496625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951035.496648:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944901888:0@lo:400:kworker.0 00000100:00100000:0.0:1783951035.496673:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951035.496693:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944902400:0@lo:400:kworker.0 00000100:00100000:0.0:1783951035.496715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951035.497748:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901888 00000100:00100000:1.0:1783951035.497756:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901888 00000100:00100000:2.0:1783951035.497903:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944900864 00000100:00100000:2.0:1783951035.497908:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944900864 00000100:00080000:3.0:1783951035.497972:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951035.497977:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951035.498023:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944900736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951035.498205:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902400 00000100:00100000:0.0:1783951035.498210:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902400 00000100:00100000:0.0:1783951035.498323:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783951035.498333:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951035.498400:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944902400:12345-0@lo:400:kworker.0 Request processed in 69us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951035.498418:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:0.0:1783951035.498439:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951035.498462:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944902400:0@lo:400:kworker.0 00000100:00100000:0.0:1783951035.498495:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944901376 00000100:00100000:0.0:1783951035.498498:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944901376 00000100:00100000:0.0:1783951035.498527:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783951035.498534:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944901376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951035.498573:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944901376:12345-0@lo:400:kworker.0 Request processed in 39us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951035.498580:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783951035.498671:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944901376:0@lo:400:kworker.0 00000100:00100000:1.0:1783951035.498850:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783951035.498868:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944901888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951035.498910:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944901888:12345-0@lo:400:kworker.0 Request processed in 52us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951035.498917:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1783951035.498945:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b0e680 x1870607944901888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951035.498956:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944901888:0@lo:400:kworker.0 00000100:00100000:2.0:1783951035.502463:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783951035.502478:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944900864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951035.502505:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951035.502584:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944900864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951035.502602:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783951035.502658:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944900864:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783951036.515262:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951037.188571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951037.188640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951037.188675:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951037.188696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951037.188722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951037.188754:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837568 00000100:00100000:0.0:1783951037.188762:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837568 00000100:00100000:0.0:1783951037.188819:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837824 00000100:00100000:0.0:1783951037.188823:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837824 00000100:00100000:0.0:1783951037.188837:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837696 00000100:00100000:0.0:1783951037.188839:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837696 00000100:00100000:0.0:1783951037.188852:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837952 00000100:00100000:0.0:1783951037.188854:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837952 00000100:00100000:0.0:1783951037.188871:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 265 00000100:00100000:0.0:1783951037.188881:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923837568:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951037.188965:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923837568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951037.188986:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 265 00000100:00100000:0.0:1783951037.189004:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 266 00000100:00100000:0.0:1783951037.189011:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923837824:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951037.189039:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923837824:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951037.189045:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 266 00000100:00100000:0.0:1783951037.189059:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 267 00000100:00100000:0.0:1783951037.189078:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923837696:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951037.189103:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923837696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951037.189109:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 267 00000100:00100000:0.0:1783951037.189121:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 268 00000100:00100000:0.0:1783951037.189128:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923837952:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951037.189179:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923837952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 51us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951037.189184:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 268 00000100:00100000:3.0:1783951037.189584:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923837440 00000100:00100000:3.0:1783951037.189590:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923837440 00000100:00100000:3.0:1783951037.189636:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 380 00000100:00100000:3.0:1783951037.189643:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923837440:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951037.189678:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923837440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 36us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951037.189684:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 380 00000100:00080000:3.0:1783951037.189711:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951037.189716:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951037.536500:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951037.536525:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944902528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951037.536596:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951037.536680:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902528 00000100:00100000:3.0:1783951037.536688:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902528 00000100:00100000:3.0:1783951037.536731:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783951037.536740:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944902528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951037.536774:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783951037.536832:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944902528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951037.536845:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783951037.536931:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944902528:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951037.537113:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951038.048372:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951038.048411:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944902656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951038.048493:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951038.048660:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902656 00000100:00100000:3.0:1783951038.048669:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902656 00000100:00100000:3.0:1783951038.048739:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783951038.048750:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944902656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951038.048780:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951038.048829:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944902656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951038.048836:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1783951038.048936:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b88000 x1870607944902656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951038.048937:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951038.048956:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944902656:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783951038.563971:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951038.569319:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951038.569344:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944902784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951038.569416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951038.569475:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902784 00000100:00100000:2.0:1783951038.569483:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902784 00000001:00100000:0.0:1783951038.570410:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:0.0:1783951038.570417:0:9517:0:(genops.c:906:class_export_put()) final put ffff9e0248050000/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000100:00100000:2.0:1783951038.570692:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783951038.570706:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944902784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951038.570733:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951038.570800:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944902784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951038.570808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1783951038.570830:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783951038.570861:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc6aa00 x1870607944902784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951038.570882:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944902784:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1783951038.571179:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248050000/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-OST0001 00000020:00000080:1.0:1783951038.571224:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0248053000 for lustre-OST0001 00000001:02000400:3.0:1783951038.989385:0:14068:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:57:17 (1783951037) 00010000:00010000:1.0:1783951039.584425:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951040.608569:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944903296:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.608711:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944902912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.608785:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.608814:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944903040:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.608825:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944903424:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.608847:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951040.608849:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951040.608864:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944903936:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.608864:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944903552:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.608884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.608898:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951040.608900:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944904448:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.608912:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944904064:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.608919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.608930:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.608944:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783951040.608950:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944903168:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.608970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.608984:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944903680:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.608986:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903936 00000100:00100000:3.0:1783951040.608992:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903936 00000100:00100000:0.0:1783951040.609001:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.609015:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944904192:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.609049:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951040.609054:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904448 00000100:00100000:3.0:1783951040.609057:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904448 00000100:00100000:0.0:1783951040.609068:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944904576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951040.609081:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783951040.609090:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944903936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.609090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.609115:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903040 00000100:00100000:0.0:1783951040.609119:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903040 00000100:00100000:0.0:1783951040.609155:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903552 00000100:00100000:3.0:1783951040.609157:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944903936:12345-0@lo:400:kworker.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.609158:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903552 00000100:00100000:3.0:1783951040.609172:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783951040.609172:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904064 00000100:00100000:0.0:1783951040.609174:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904064 00000100:00100000:0.0:1783951040.609185:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903680 00000100:00100000:3.0:1783951040.609187:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783951040.609187:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903680 00000100:00100000:3.0:1783951040.609192:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944904448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.609198:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904192 00000100:00100000:0.0:1783951040.609200:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904192 00000100:00100000:0.0:1783951040.609212:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783951040.609218:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944903040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.609221:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944904448:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951040.609226:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1783951040.609261:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b89180 x1870607944903936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951040.609277:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944903936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951040.609387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944902912 00000100:00100000:2.0:1783951040.609392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944902912 00000100:00100000:2.0:1783951040.609436:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1783951040.609443:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944902912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.613491:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944903040:12345-0@lo:400:kworker.0 Request processed in 4262us (4632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.613508:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783951040.613587:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783951040.613609:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944903552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.613692:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944903552:12345-0@lo:400:kworker.0 Request processed in 89us (4793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.613698:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783951040.613833:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951040.613862:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944903808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.613892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951040.613920:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944904320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.613939:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951040.613972:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903808 00000100:00100000:1.0:1783951040.613979:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903808 00000100:00100000:1.0:1783951040.614007:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904320 00000100:00100000:1.0:1783951040.614009:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904320 00000100:00100000:1.0:1783951040.614022:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783951040.614028:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944903808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614074:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944903808:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.614080:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783951040.614093:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783951040.614099:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944904320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614123:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944904320:12345-0@lo:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.614135:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1783951040.614200:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1783951040.614230:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b89f80 x1870607944903808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951040.614243:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944903808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614253:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944904320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614302:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903296 00000100:00100000:1.0:1783951040.614305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903296 00000100:00100000:1.0:1783951040.614324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783951040.614331:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944904064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614365:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944904064:12345-0@lo:400:kworker.0 Request processed in 34us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.614371:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783951040.614383:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783951040.614390:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944903680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944903680:12345-0@lo:400:kworker.0 Request processed in 30us (5416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.614425:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783951040.614437:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783951040.614444:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944904192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951040.614472:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944904192:12345-0@lo:400:kworker.0 Request processed in 29us (5423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.614477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783951040.614490:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1783951040.614503:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944903296:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783951040.614640:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b8bb80 x1870607944903680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951040.614652:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944903680:0@lo:400:kworker.0 00010000:00080000:0.0:1783951040.614663:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0351b88000 x1870607944904192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951040.614670:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944904192:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.614681:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944903040:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.614690:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944903552:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.614700:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944904064:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.614715:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951040.614723:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944904704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951040.614748:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951040.614773:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904576 00000100:00100000:0.0:1783951040.614777:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904576 00000100:00100000:0.0:1783951040.614795:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904704 00000100:00100000:0.0:1783951040.614797:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904704 00000100:00100000:0.0:1783951040.614807:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783951040.614812:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944904576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951040.614833:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951040.614877:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944904576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (5786us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.614883:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783951040.614895:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783951040.614901:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944904704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951040.614909:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951040.614934:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944904704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.614939:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783951040.614966:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944904704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951040.614979:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944904576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951040.615027:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944904832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951040.615064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951040.615115:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951040.615120:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951040.615124:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951040.615126:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951040.615135:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903424 00000100:00100000:0.0:1783951040.615139:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903424 00000100:00100000:0.0:1783951040.615177:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944903168 00000100:00100000:0.0:1783951040.615180:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944903168 00000100:00100000:0.0:1783951040.615188:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904832 00000100:00100000:0.0:1783951040.615190:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904832 00000100:00100000:0.0:1783951040.615202:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783951040.615207:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944903424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.615241:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944903424:12345-0@lo:400:kworker.0 Request processed in 33us (6390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.615256:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783951040.615270:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783951040.615275:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944903168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.615312:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944903168:12345-0@lo:400:kworker.0 Request processed in 35us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.615317:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783951040.615328:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783951040.615334:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944904832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951040.615354:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783951040.615386:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944904832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.615392:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783951040.615437:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944903168:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.615460:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944904832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951040.615776:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944903296:12345-0@lo:400:kworker.0 Request processed in 1272us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.615782:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783951040.616063:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944903296:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.618634:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944904448:0@lo:400:kworker.0 00000100:00100000:3.0:1783951040.618672:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944903424:0@lo:400:kworker.0 00000100:00100000:2.0:1783951040.618858:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944902912:12345-0@lo:400:kworker.0 Request processed in 9412us (10070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951040.618870:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1783951040.619069:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944902912:0@lo:400:kworker.0 00000100:00100000:0.0:1783951040.670023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951040.670130:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838080 00000100:00100000:2.0:1783951040.670173:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838080 00000100:00100000:2.0:1783951040.670243:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:2.0:1783951040.670254:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:11105:x1870607923838080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951040.670289:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951040.670314:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f82e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f570 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951040.670395:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f82ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951040.670409:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f82ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951040.670422:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f82ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951040.670480:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951040.670484:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951040.670521:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f82ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951040.670547:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f82e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f570 expref: 7 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951040.670567:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f82ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f570 expref: 6 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951040.670576:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:2.0:1783951040.670580:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951040.670584:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948400, rc 0) 00000100:00100000:2.0:1783951040.670644:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:11105:x1870607923838080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 391us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951040.670661:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00080000:0.0:1783951040.670912:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951040.675789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951040.675886:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838208 00000100:00100000:0.0:1783951040.675901:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838208 00000100:00100000:0.0:1783951040.675981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:0.0:1783951040.675990:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:11106:x1870607923838208:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951040.676010:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951040.676040:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f82f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f577 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676119:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676131:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676179:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676196:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676204:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676210:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676268:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f830a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676276:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f830a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676282:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f830a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951040.676320:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951040.676324:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951040.676345:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f830a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676512:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676520:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676527:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676533:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5dc00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951040.676537:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676544:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676557:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:0.0:1783951040.676560:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951040.676564:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676570:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f82fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676583:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676589:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676595:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676607:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951040.676610:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676616:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676624:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e0247832000) 00010000:00010000:0.0:1783951040.676626:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951040.676629:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676635:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8303 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676663:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f82f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f577 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676675:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f830a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f577 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951040.676683:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e0247832c00) 00010000:00010000:0.0:1783951040.676685:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951040.676687:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5cc00, rc 0) 00000100:00100000:0.0:1783951040.676757:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11106:x1870607923838208:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 767us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951040.676763:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:2.0:1783951040.678842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951040.678940:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838336 00000100:00100000:3.0:1783951040.678949:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838336 00000100:00100000:3.0:1783951040.679002:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951040.679011:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11106:x1870607923838336:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783951040.679097:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11106:x1870607923838336:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951040.679105:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951040.680590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951040.680674:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838592 00000100:00100000:1.0:1783951040.680681:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838592 00000100:00100000:1.0:1783951040.680746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:1.0:1783951040.680755:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11106:x1870607923838592:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951040.680774:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951040.680798:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8311 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f57e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.680894:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.680913:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.680926:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.680983:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.680991:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.680998:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681190:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8326 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681199:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681207:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951040.681216:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783951040.681307:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681315:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681321:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681328:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951040.681332:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681340:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681352:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e0247832c00) 00010000:00010000:1.0:1783951040.681355:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951040.681360:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681524:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8318 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681538:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681544:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681551:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681556:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951040.681559:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681565:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681573:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e0246937d00) 00010000:00010000:1.0:1783951040.681575:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951040.681578:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681584:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f831f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681861:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8311 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f57e expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681877:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8326 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f57e expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951040.681892:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951040.681895:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951040.681897:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67a00, rc 0) 00000100:00100000:1.0:1783951040.681965:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:11106:x1870607923838592:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1210us (1380us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783951040.681973:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:2.0:1783951040.694807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951040.694921:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838720 00000100:00100000:3.0:1783951040.694945:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838720 00000100:00100000:3.0:1783951040.695063:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:3.0:1783951040.695098:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:11106:x1870607923838720:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783951040.695346:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:11106:x1870607923838720:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 251us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951040.695355:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:2.0:1783951040.701716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951040.701829:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838848 00000100:00100000:0.0:1783951040.701859:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838848 00000100:00100000:0.0:1783951040.701951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:0.0:1783951040.701962:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:11106:x1870607923838848:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1783951040.702312:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1783951040.706292:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4285us 00000100:00100000:1.0:1783951040.732350:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:11106:x1870607923838848:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 30375us (30634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951040.732368:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00010000:00010000:0.0:1783951041.632388:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951041.633426:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783951041.633612:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951042.306098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.306425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.306451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.306484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.306538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951042.306660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923838976 00000100:00100000:2.0:1783951042.306673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923838976 00000100:00100000:1.0:1783951042.306679:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923839104 00000100:00100000:1.0:1783951042.306686:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923839104 00000100:00100000:2.0:1783951042.306746:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 382 00000100:00100000:1.0:1783951042.306747:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923839360 00000100:00100000:1.0:1783951042.306752:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923839360 00000100:00100000:2.0:1783951042.306759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923838976:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951042.306786:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923839232 00000100:00100000:1.0:1783951042.306790:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923839232 00000100:00100000:1.0:1783951042.306809:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923839488 00000100:00100000:1.0:1783951042.306812:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923839488 00000100:00100000:1.0:1783951042.306833:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 275 00000100:00100000:1.0:1783951042.306842:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2410:x1870607923839104:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951042.306870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923838976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 112us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951042.306879:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 382 00000100:00100000:1.0:1783951042.306891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2410:x1870607923839104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 48us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.306899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 275 00000100:00100000:2.0:1783951042.306927:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 276 00000100:00100000:2.0:1783951042.306943:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923839360:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951042.306971:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923839360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.307402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 277 00000100:00100000:2.0:1783951042.307419:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 276 00000100:00100000:1.0:1783951042.307419:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923839232:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951042.307444:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 278 00000100:00100000:2.0:1783951042.307454:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923839488:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951042.307490:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923839488:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 38us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951042.307497:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 278 00000100:00080000:2.0:1783951042.307519:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951042.307530:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951042.308595:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923839232:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1174us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.308608:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 277 00010000:00010000:1.0:1783951042.656363:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951042.656630:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951042.656651:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944904960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951042.656719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951042.656783:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944904960 00000100:00100000:0.0:1783951042.656789:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944904960 00000100:00100000:0.0:1783951042.656833:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951042.656842:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944904960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951042.656893:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783951042.656939:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944904960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951042.656946:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951042.657005:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944904960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951042.739317:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951042.739485:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923839616 00000100:00100000:1.0:1783951042.739503:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923839616 00000100:00100000:1.0:1783951042.739565:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1783951042.739576:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:11149:x1870607923839616:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951042.739598:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951042.739620:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f585 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739682:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739696:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739708:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739722:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739730:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739737:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739793:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739801:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739808:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739815:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951042.739819:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739827:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739839:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951042.739843:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951042.739848:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739855:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f833b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739868:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739876:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739882:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739895:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951042.739897:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739902:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739909:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e0246937d00) 00010000:00010000:1.0:1783951042.739911:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951042.739914:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739918:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8342 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739949:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8334 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f585 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739959:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951042.739961:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951042.739964:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f585 expref: 10 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.739974:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67000, rc 0) 00000100:00100000:1.0:1783951042.740055:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:11149:x1870607923839616:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 480us (749us total) trans 0 rc 301/301 00000100:00100000:1.0:1783951042.740062:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:3.0:1783951042.753656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.753755:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923839872 00000100:00100000:0.0:1783951042.753767:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923839872 00000100:00100000:0.0:1783951042.753838:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:0.0:1783951042.753849:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:11149:x1870607923839872:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:0.0:1783951042.753916:0:10105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951042.753943:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f82ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f570 expref: 9 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.753960:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:0.0:1783951042.753971:0:10105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951042.754046:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.754060:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.754070:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.754082:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.754088:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.754094:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755712:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755730:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755740:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951042.755765:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005dd287b1 reply state 00000000990748c6 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755776:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755783:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951042.755786:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951042.755789:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783951042.755794:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783951042.755802:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755809:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755815:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755820:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951042.755824:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755831:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755839:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024782e900) 00010000:00010000:0.0:1783951042.755841:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951042.755845:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755861:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8349 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951042.755879:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005dd287b1 reply state 00000000990748c6 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755887:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.755893:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e024782e800) 00010000:00010000:0.0:1783951042.755895:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951042.755897:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783951042.760161:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:11149:x1870607923839872:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 6289us (6489us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783951042.760175:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:3.0:1783951042.853747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951042.853874:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840000 00000100:00100000:1.0:1783951042.853900:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840000 00000100:00100000:1.0:1783951042.853986:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:1.0:1783951042.853997:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:11157:x1870607923840000:12345-192.168.202.33@tcp:101:lctl.0 00010000:00010000:1.0:1783951042.854033:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951042.854057:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f835e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f58c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.854125:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8365 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.854138:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.854194:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951042.854246:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951042.854250:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951042.854285:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.854311:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f835e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f58c expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.854330:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f58c expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.854339:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:1.0:1783951042.854343:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951042.854346:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:3.0:1783951042.854633:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:11157:x1870607923840000:12345-192.168.202.33@tcp:101:lctl.0 Request processed in 636us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951042.854642:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:0.0:1783951042.931215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951042.931310:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840128 00000100:00100000:1.0:1783951042.931319:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840128 00000100:00100000:1.0:1783951042.931395:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:1.0:1783951042.931405:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:11163:x1870607923840128:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951042.931427:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951042.931449:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f836c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f593 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931515:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931529:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931541:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931554:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931562:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931569:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931655:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8381 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931664:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931688:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951042.931728:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783951042.931732:0:11194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951042.931765:0:11194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931777:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931783:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931790:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931796:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951042.931800:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931807:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931819:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:1.0:1783951042.931822:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951042.931826:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931832:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931857:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931863:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931868:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931873:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951042.931876:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931882:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931890:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e024782e800) 00010000:00010000:1.0:1783951042.931893:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951042.931895:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931901:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f837a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931926:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f836c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f593 expref: 13 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931940:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f593 expref: 12 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.931958:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:1.0:1783951042.931960:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951042.931963:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66400, rc 0) 00000100:00100000:1.0:1783951042.932037:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:11163:x1870607923840128:12345-192.168.202.33@tcp:101:bash.0 Request processed in 634us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.932046:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:2.0:1783951042.935266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.935470:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840384 00000100:00100000:0.0:1783951042.935480:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840384 00000100:00100000:0.0:1783951042.935543:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:0.0:1783951042.935554:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:11163:x1870607923840384:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951042.935574:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951042.935595:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8388 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f59a expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.935695:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.935710:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.935732:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.935797:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.935805:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.935812:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951042.936202:0:10105:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1783951042.936350:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936360:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936485:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936524:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936531:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936538:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936544:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951042.936557:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936565:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936578:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951042.936581:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951042.936585:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936591:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f838f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951042.936604:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001125d495 reply state 000000003be7accd transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936615:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936621:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:0.0:1783951042.936623:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951042.936625:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951042.936655:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8388 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 15 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936671:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 14 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.936679:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:0.0:1783951042.936681:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951042.936689:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5ce00, rc 0) 00000100:00100000:0.0:1783951042.936751:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:11163:x1870607923840384:12345-192.168.202.33@tcp:101:bash.0 Request processed in 1199us (1493us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783951042.936760:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:3.0:1783951042.941313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951042.943096:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840512 00000100:00100000:1.0:1783951042.943112:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840512 00000100:00100000:1.0:1783951042.943190:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:1.0:1783951042.943200:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870607923840512:12345-192.168.202.33@tcp:8:bash.0 00010000:00080000:1.0:1783951042.943238:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1783951042.943279:0:8441:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f83ab 00002000:00100000:1.0:1783951042.943291:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75392fba-af18-4ae6-9b8a-6f1db7dcbeed/ffff9e0248106800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951042.943311:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951042.943404:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783951042.943436:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e0248100800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951042.943509:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923840512:12345-192.168.202.33@tcp:8:bash.0 Request processed in 310us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.943517:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:1.0:1783951042.951834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951042.955072:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840640 00000100:00100000:0.0:1783951042.955089:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840640 00000100:00080000:2.0:1783951042.955200:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951042.955200:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:0.0:1783951042.955210:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923840640:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951042.955231:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951042.955257:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5a1 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951042.955283:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951042.955304:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1783951042.955308:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951042.955318:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.955338:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951042.955353:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5da00, rc 0) 00000100:00100000:0.0:1783951042.955549:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:0:x1870607923840640:12345-192.168.202.33@tcp:101:bash.0 Request processed in 339us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951042.955557:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:2.0:1783951042.963315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951042.963424:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840768 00000100:00100000:1.0:1783951042.963434:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840768 00000100:00100000:1.0:1783951042.963498:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:1.0:1783951042.963508:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11163:x1870607923840768:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951042.963543:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951042.963565:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5a8 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.963598:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.963608:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951042.963612:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951042.963616:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.963652:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.963666:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951042.963681:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1870607944905088:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951042.963790:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951042.966283:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1870607944905088:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951042.966321:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.966342:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951042.966421:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:11163:x1870607923840768:12345-192.168.202.33@tcp:101:bash.0 Request processed in 2913us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.966431:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:0.0:1783951042.967251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951042.967324:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923840896 00000100:00100000:1.0:1783951042.967333:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923840896 00010000:00010000:1.0:1783951042.967366:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951042.967601:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1783951042.967613:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2407:x1870607923840896:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951042.967629:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951042.967648:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.967660:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.967684:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f83b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a1 expref: 8 pid: 8440 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.967699:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951042.967702:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951042.967710:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.967718:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951042.967759:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951042.967773:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1870607944905216:192.168.202.33@tcp:105: 00000100:00100000:1.0:1783951042.967890:0:6509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951042.986092:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1870607944905216:192.168.202.33@tcp:105: 00010000:00010000:1.0:1783951042.986119:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951042.986287:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923840896:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 18676us (19038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951042.986300:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:2.0:1783951042.990625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951042.990999:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923841152 00000100:00100000:3.0:1783951042.991021:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923841152 00000100:00100000:3.0:1783951042.991126:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:3.0:1783951042.991138:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:11163:x1870607923841152:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:3.0:1783951042.991521:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11163:x1870607923841152:12345-192.168.202.33@tcp:35:bash.0 Request processed in 384us (905us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783951042.991530:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:0.0:1783951043.050428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.050656:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923841408 00000100:00100000:3.0:1783951043.050667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923841408 00000100:00100000:3.0:1783951043.050738:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:3.0:1783951043.050750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11173:x1870607923841408:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951043.050776:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951043.050797:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f83c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5af expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951043.050933:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783951043.051072:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f83c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5af expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.051088:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:3.0:1783951043.051092:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951043.051098:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f83c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5af expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.051112:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144000, rc 0) 00000100:00100000:3.0:1783951043.051232:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:11173:x1870607923841408:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 484us (816us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1783951043.051240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:0.0:1783951043.054611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.054747:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923841664 00000100:00100000:2.0:1783951043.054757:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923841664 00000100:00100000:2.0:1783951043.054813:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951043.054823:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:11173:x1870607923841664:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951043.055076:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:11173:x1870607923841664:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 253us (474us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783951043.055084:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951043.123763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951043.124640:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923841792 00000100:00100000:0.0:1783951043.124658:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923841792 00000100:00100000:0.0:1783951043.124751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:0.0:1783951043.124763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:11179:x1870607923841792:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951043.124797:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951043.124826:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f83ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.125074:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f83d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.125121:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f83d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.125135:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f83d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951043.125259:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783951043.125264:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951043.125288:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f83d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.125324:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f83ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5b6 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.125348:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f83d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5b6 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.125358:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951043.125379:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951043.125383:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951043.126026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:11179:x1870607923841792:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1261us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951043.126036:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:0.0:1783951043.130603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.130749:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923842048 00000100:00100000:2.0:1783951043.130762:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923842048 00000100:00100000:2.0:1783951043.130836:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:2.0:1783951043.130848:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:11179:x1870607923842048:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951043.130887:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951043.130915:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f83dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5bd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.131087:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f83e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.131104:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f83e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.131120:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f83e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951043.131193:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783951043.131348:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f83dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5bd expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.131368:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f83e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5bd expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.131377:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:2.0:1783951043.131380:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951043.131384:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948e00, rc 0) 00000100:00100000:2.0:1783951043.131480:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:11179:x1870607923842048:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 625us (883us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783951043.131490:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1783951043.134687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.134820:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923842176 00000100:00100000:3.0:1783951043.134832:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923842176 00000100:00100000:3.0:1783951043.134929:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:3.0:1783951043.134942:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:2409:x1870607923842176:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951043.134964:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951043.134996:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f83e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5bd expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.135037:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:3.0:1783951043.135044:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951043.135115:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:2409:x1870607923842176:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 175us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951043.135183:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1783951043.138537:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.138683:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923842432 00000100:00100000:1.0:1783951043.138696:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923842432 00000100:00100000:1.0:1783951043.138771:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:1.0:1783951043.138784:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11179:x1870607923842432:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951043.138816:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951043.138842:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f83f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5c4 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.139023:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f83f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.139043:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f83f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.139057:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f83f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951043.139093:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783951043.139450:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f83f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5c4 expref: 23 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.139485:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f83f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5c4 expref: 22 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.139495:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:1.0:1783951043.139498:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783951043.139502:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67c00, rc 0) 00000100:00100000:1.0:1783951043.139580:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11179:x1870607923842432:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 799us (1056us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783951043.139588:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:0.0:1783951043.143992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.144119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923842560 00000100:00100000:3.0:1783951043.144132:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923842560 00000100:00100000:3.0:1783951043.144238:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:3.0:1783951043.144252:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923842560:12345-192.168.202.33@tcp:1:lfs.0 00010000:00010000:3.0:1783951043.144320:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.144348:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.144359:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951043.144364:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951043.144370:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.144419:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.144436:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 7 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951043.144454:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1870607944905344:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951043.144587:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342972600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951043.153457:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.153926:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923842688 00000100:00100000:1.0:1783951043.153947:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923842688 00002000:00100000:1.0:1783951043.154028:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9e0381128e00 x1870607923842688/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:59/0 lens 504/0 e 0 to 0 dl 1783951054 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951043.154040:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0381128e00 with x1870607923842688 ext(0->12) 00010000:00010000:1.0:1783951043.154051:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 8 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.154073:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 8 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951043.154081:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e0381128e00 00000100:00100000:1.0:1783951043.154134:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:1.0:1783951043.154205:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923842688:12345-192.168.202.33@tcp:4:lfs.0 00000100:00100000:3.0:1783951043.155067:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1870607944905344:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951043.155116:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1783951043.157804:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000100:00100000:1.0:1783951043.159763:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923842688:12345-192.168.202.33@tcp:4:lfs.0 Request processed in 5544us (6298us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783951043.159781:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00002000:00100000:1.0:1783951043.159799:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9e0381128e00 x1870607923842688/t4294967300(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:59/0 lens 504/448 e 0 to 0 dl 1783951054 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951043.159811:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0381128e00 with x1870607923842688 ext(0->12) 00010000:00010000:1.0:1783951043.159823:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 9 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.159847:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 9 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951043.159922:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e0381128e00 00000100:00100000:3.0:1783951043.162822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.166976:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923842816 00000100:00100000:2.0:1783951043.166999:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923842816 00010000:00010000:2.0:1783951043.167085:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 9 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951043.167257:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:2.0:1783951043.167269:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923842816:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951043.167292:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783951043.167318:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783951043.167321:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783951042 00002000:00010000:2.0:1783951043.167324:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783951043 00002000:00010000:2.0:1783951043.167326:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783951042 00002000:00010000:2.0:1783951043.167329:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783951043.167354:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 9 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.167369:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 9 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.167403:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f83b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5a8 expref: 9 pid: 8441 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.167426:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951043.167431:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951043.167439:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.167450:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.168691:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951043.168793:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2407:x1870607923842816:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 1520us (5977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951043.168807:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00010000:00010000:0.0:1783951043.168914:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.168929:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.168963:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.168972:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.168980:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.168988:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951043.168993:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.169028:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.169050:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.169059:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d43768e/0x7645c8e1169f8406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951043.169128:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923842560:12345-192.168.202.33@tcp:1:lfs.0 Request processed in 24880us (25153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951043.169137:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:1.0:1783951043.178620:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944905472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951043.178721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951043.178853:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944905472 00000100:00100000:0.0:1783951043.178864:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944905472 00000100:00100000:0.0:1783951043.178950:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783951043.178962:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944905472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951043.178992:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951043.179060:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944905472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951043.179068:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1783951043.179176:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951043.179235:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944905472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951043.185599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.187794:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923843072 00000100:00100000:2.0:1783951043.187815:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923843072 00000100:00100000:2.0:1783951043.187893:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:2.0:1783951043.187906:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11179:x1870607923843072:12345-192.168.202.33@tcp:35:lfs.0 00000004:00010000:2.0:1783951043.187996:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f83f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5c4 expref: 22 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951043.190780:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1783951043.190850:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783951043.198974:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1783951043.199079:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.199114:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 26 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.199123:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.199187:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 26 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.199205:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 26 pid: 10105 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951043.199221:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248013480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1870607944905600:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951043.199540:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951043.206922:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248013480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1870607944905600:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951043.206954:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951043.208321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.208919:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923843200 00000100:00100000:3.0:1783951043.208937:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923843200 00010000:00010000:3.0:1783951043.208998:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 27 pid: 10105 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951043.209054:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1783951043.209065:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:2408:x1870607923843200:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951043.209085:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951043.209093:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 27 pid: 10105 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.209108:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 27 pid: 10105 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.209133:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f839d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f59a expref: 27 pid: 10105 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.209188:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:3.0:1783951043.209194:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.209204:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.209233:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.209265:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951043.209353:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.209367:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951043.209441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:2408:x1870607923843200:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 375us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951043.209451:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000001:00080000:0.0:1783951043.209754:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1783951043.209885:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1783951043.209980:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248012680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944905728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783951043.210063:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951043.210095:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951043.210360:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944905728 00000100:00100000:3.0:1783951043.210369:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944905728 00000100:00100000:3.0:1783951043.210442:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783951043.210450:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1870607944905728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783951043.210586:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1870607944905728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951043.210594:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1783951043.211115:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951043.211594:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248012680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944905728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783951043.211794:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1783951043.211865:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248012680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944905856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783951043.211916:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951043.211951:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951043.211991:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944905856 00000100:00100000:1.0:1783951043.212000:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944905856 00000100:00100000:1.0:1783951043.212069:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783951043.212079:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1870607944905856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783951043.212306:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6528:x1870607944905856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 228us (389us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783951043.212333:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783951043.213776:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248012680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944905856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783951043.213860:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1783951043.213915:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.213927:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.213935:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.213943:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951043.213948:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.213956:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.213970:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:0.0:1783951043.213974:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783951043.213978:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.214001:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f840d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951043.214127:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783951043.214227:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783951043.214239:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398862096496ns, next at 399862094475ns, rc = 0 00000001:00080000:0.0:1783951043.214248:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1783951043.214272:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:0.0:1783951043.214275:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783951043.214282:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f83f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5c4 expref: 30 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951043.214408:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:11179:x1870607923843072:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 26504us (28821us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1783951043.214426:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000020:00080000:0.0:1783951043.214433:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783951043.221720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951043.221790:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923843328 00000100:00100000:0.0:1783951043.221804:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923843328 00000100:00100000:0.0:1783951043.221874:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:0.0:1783951043.221886:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:11179:x1870607923843328:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951043.221914:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951043.221939:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8414 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5cb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.222001:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8414 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5cb expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.222047:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8414 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5cb expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.222070:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951043.222073:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951043.222076:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d400, rc 0) 00000100:00100000:0.0:1783951043.222178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11179:x1870607923843328:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 259us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951043.222263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1783951043.225718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.226023:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923843584 00000100:00100000:1.0:1783951043.226037:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923843584 00000100:00100000:1.0:1783951043.226106:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1783951043.226118:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03494c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11179:x1870607923843584:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1783951043.226519:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03494c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+31:11179:x1870607923843584:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 401us (814us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1783951043.226529:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1783951043.312925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.313078:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923843840 00000100:00100000:3.0:1783951043.313092:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923843840 00000100:00100000:3.0:1783951043.313217:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:3.0:1783951043.313230:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+31:11189:x1870607923843840:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951043.313274:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951043.313299:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f841b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5d2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951043.313439:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783951043.313595:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f841b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d2 expref: 33 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.313636:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:3.0:1783951043.313639:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951043.313647:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f841b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d2 expref: 33 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.313664:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:3.0:1783951043.313746:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11189:x1870607923843840:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 519us (837us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1783951043.313754:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:2.0:1783951043.316885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.317032:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923843968 00000100:00100000:3.0:1783951043.317046:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923843968 00000100:00100000:3.0:1783951043.317124:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:3.0:1783951043.317136:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11189:x1870607923843968:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:3.0:1783951043.317259:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317280:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317295:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317310:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317318:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317347:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317455:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317463:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317470:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951043.317536:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317674:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317680:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317687:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317692:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951043.317697:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317704:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317718:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951043.317728:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951043.317734:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317741:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8429 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317760:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317766:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317772:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317777:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951043.317780:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317786:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317794:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:3.0:1783951043.317796:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951043.317799:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317806:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8430 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317819:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317831:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317837:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317843:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951043.317847:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317916:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317926:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951043.317928:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951043.317931:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.317937:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8437 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951043.318097:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11189:x1870607923843968:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 961us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951043.318107:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:0.0:1783951043.321980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.322179:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923844224 00000100:00100000:2.0:1783951043.322192:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923844224 00000100:00100000:2.0:1783951043.322416:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1783951043.322430:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11189:x1870607923844224:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951043.322750:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:11189:x1870607923844224:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 322us (783us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1783951043.322758:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:1.0:1783951043.352404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951043.352588:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923844480 00000100:00100000:0.0:1783951043.352602:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923844480 00000100:00100000:0.0:1783951043.352680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:0.0:1783951043.352693:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:11192:x1870607923844480:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951043.352728:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951043.352754:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f843e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5d9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.352864:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.352881:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.352895:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.352930:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.352938:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.352944:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353111:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353120:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353128:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951043.353191:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783951043.353316:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353325:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353332:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353339:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951043.353344:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353362:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353379:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951043.353383:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951043.353388:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353394:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8445 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353410:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353416:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353422:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353428:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951043.353431:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353436:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353443:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:0.0:1783951043.353446:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951043.353449:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353467:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f844c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353515:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f843e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353531:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.353538:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951043.353541:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951043.353543:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5dc00, rc 0) 00000100:00100000:0.0:1783951043.353630:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11192:x1870607923844480:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 939us (1238us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783951043.353639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:3.0:1783951043.357040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.357092:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923844608 00000100:00100000:1.0:1783951043.357105:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923844608 00000100:00100000:1.0:1783951043.357201:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:1.0:1783951043.357214:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11192:x1870607923844608:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:1.0:1783951043.357314:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357335:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357350:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357398:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357404:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357430:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357437:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951043.357442:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357450:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357464:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951043.357467:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951043.357472:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.357479:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8461 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951043.357574:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11192:x1870607923844608:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 362us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951043.357583:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:3.0:1783951043.359250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.359626:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923844864 00000100:00100000:1.0:1783951043.359638:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923844864 00000100:00100000:1.0:1783951043.359712:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:1.0:1783951043.359723:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11192:x1870607923844864:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1783951043.360430:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:11192:x1870607923844864:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 703us (1186us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1783951043.360441:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:3.0:1783951043.559496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951043.559566:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923845120 00000100:00100000:0.0:1783951043.559577:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923845120 00000100:00100000:0.0:1783951043.559637:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:0.0:1783951043.559647:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:11223:x1870607923845120:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:0.0:1783951043.559677:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951043.559699:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8468 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5e0 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.559840:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f846f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.559854:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f846f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.559881:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f846f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951043.559892:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783951043.560074:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8468 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e0 expref: 39 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.560095:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f846f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e0 expref: 38 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.560103:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951043.560106:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951043.560125:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d600, rc 0) 00000100:00100000:0.0:1783951043.560341:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11223:x1870607923845120:12345-192.168.202.33@tcp:101:cat.0 Request processed in 694us (857us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1783951043.560349:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:3.0:1783951043.562872:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.563106:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923845248 00000100:00100000:1.0:1783951043.563118:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923845248 00000100:00100000:1.0:1783951043.563434:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:1.0:1783951043.563446:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:2409:x1870607923845248:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951043.563467:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951043.563499:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f846f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e0 expref: 38 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.563520:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951043.563524:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951043.563580:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:2409:x1870607923845248:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 137us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951043.563586:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:3.0:1783951043.563779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951043.563926:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923845504 00000100:00100000:0.0:1783951043.563932:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923845504 00000100:00100000:0.0:1783951043.563970:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:0.0:1783951043.563978:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:11223:x1870607923845504:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:0.0:1783951043.564353:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11223:x1870607923845504:12345-192.168.202.33@tcp:35:cat.0 Request processed in 375us (573us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1783951043.564360:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1783951043.606802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951043.606888:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923845760 00000100:00100000:0.0:1783951043.606902:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923845760 00000100:00100000:0.0:1783951043.606980:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:0.0:1783951043.606994:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11229:x1870607923845760:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:0.0:1783951043.607056:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951043.607060:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783951043.607097:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f83d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5b6 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951043.607122:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951043.607128:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951043.607206:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f847d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5e7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.607616:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.607634:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.607643:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.607685:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.607701:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 38 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951043.607716:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944905984:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951043.607860:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0343881300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951043.611907:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944905984:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951043.611968:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951043.612120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.612272:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923845888 00000100:00100000:1.0:1783951043.612281:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923845888 00010000:00010000:1.0:1783951043.612329:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 39 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951043.612388:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:1.0:1783951043.612399:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:2407:x1870607923845888:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951043.612490:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951043.612500:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 39 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.612526:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 39 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.612554:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8453 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5d9 expref: 39 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.612576:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951043.612581:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.612592:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.612602:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.612637:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951043.612697:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.612705:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951043.612720:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:2407:x1870607923845888:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 321us (600us total) trans 0 rc 0/0 00000004:00200000:2.0:1783951043.612728:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:1.0:1783951043.612728:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00010000:00010000:2.0:1783951043.612953:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f847d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.612970:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.612979:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951043.612981:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951043.612984:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948c00, rc 0) 00000100:00100000:2.0:1783951043.613026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11229:x1870607923845760:12345-192.168.202.33@tcp:101:dd.0 Request processed in 6036us (6239us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783951043.613033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:3.0:1783951043.617677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.617769:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923846016 00000100:00100000:2.0:1783951043.617782:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923846016 00000100:00100000:2.0:1783951043.617936:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:2.0:1783951043.617959:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11229:x1870607923846016:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:2.0:1783951043.617992:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951043.618036:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f8492 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5ee expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.618079:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.618115:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.618129:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.618320:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f8492 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 40 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.618345:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 39 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.618355:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951043.618358:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783951043.618362:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948400, rc 0) 00000100:00100000:2.0:1783951043.618452:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:11229:x1870607923846016:12345-192.168.202.33@tcp:101:dd.0 Request processed in 495us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951043.618460:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:0.0:1783951043.621435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951043.622087:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923846272 00000100:00100000:3.0:1783951043.622101:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923846272 00000100:00100000:3.0:1783951043.622226:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:3.0:1783951043.622239:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:11229:x1870607923846272:12345-192.168.202.33@tcp:36:dd.0 00010000:00010000:3.0:1783951043.622697:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.622722:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.622737:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951043.622797:0:10105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1783951043.622825:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000add7d1bd reply state 00000000bfd9919b transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.622839:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.622919:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951043.622924:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951043.622928:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951043.623114:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:11229:x1870607923846272:12345-192.168.202.33@tcp:36:dd.0 Request processed in 875us (1693us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1783951043.623123:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00000020:00080000:3.0:1783951043.623129:0:10105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783951043.680810:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944906112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951043.680918:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951043.681245:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944906112 00000100:00100000:0.0:1783951043.681256:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944906112 00000100:00100000:0.0:1783951043.681314:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783951043.681324:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944906112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951043.681358:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951043.681431:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944906112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951043.681439:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783951043.682709:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944906112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951043.683697:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951043.825647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.825768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923846400 00000100:00100000:2.0:1783951043.825781:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923846400 00000100:00100000:2.0:1783951043.825865:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:2.0:1783951043.825878:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:11243:x1870607923846400:12345-192.168.202.33@tcp:101:stat.0 00010000:00010000:2.0:1783951043.825909:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951043.825956:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f84a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5f5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826072:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826091:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826107:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826123:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826131:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826138:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826339:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826351:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826360:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826404:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.826432:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 43 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951043.826449:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944906240:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951043.826613:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0343881300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951043.830268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.830399:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923846656 00000100:00100000:1.0:1783951043.830412:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923846656 00000100:00100000:1.0:1783951043.830487:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:1.0:1783951043.830500:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+44:10801:x1870607923846656:12345-192.168.202.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783951043.830965:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+45:10801:x1870607923846656:12345-192.168.202.33@tcp:35:ldlm_bl.0 Request processed in 465us (719us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1783951043.830999:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783951043.832305:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944906240:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951043.832355:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951043.835295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951043.835662:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923846784 00000100:00100000:2.0:1783951043.835676:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923846784 00010000:00010000:2.0:1783951043.835729:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 45 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951043.835782:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:2.0:1783951043.835794:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+45:2408:x1870607923846784:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951043.835814:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951043.835822:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 45 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.835837:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 45 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.835935:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f8484 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5e7 expref: 45 pid: 6524 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.835980:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951043.835986:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.835996:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.836080:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951043.836244:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951043.836324:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+44:2408:x1870607923846784:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 531us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951043.836333:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00010000:00010000:3.0:1783951043.838111:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838207:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951043.838356:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783951043.838363:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951043.838419:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838439:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838451:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838459:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838467:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838475:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951043.838480:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838489:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838507:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951043.838511:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951043.838516:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838534:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f84ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838555:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838562:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838567:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838572:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951043.838575:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838582:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838590:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:3.0:1783951043.838592:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951043.838596:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838603:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948e00/0x7645c8e1169f84b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838651:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f84a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5f5 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838667:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5f5 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951043.838681:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951043.838683:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951043.838686:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948a00, rc 0) 00000100:00100000:3.0:1783951043.838831:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:11243:x1870607923846400:12345-192.168.202.33@tcp:101:stat.0 Request processed in 12955us (13198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951043.838841:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:0.0:1783951043.896525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951043.896652:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923847040 00000100:00100000:1.0:1783951043.896667:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923847040 00000100:00100000:1.0:1783951043.896743:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:1.0:1783951043.896756:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:11249:x1870607923847040:12345-192.168.202.33@tcp:36:truncate.0 00010000:00010000:1.0:1783951043.896839:0:11194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951043.896887:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f84bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5f5 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.896912:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951043.896918:0:11194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951043.897251:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.897279:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.897292:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951043.897352:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1783951043.897381:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000cb7478d reply state 00000000a6382022 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.897394:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951043.897401:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951043.897404:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951043.897426:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951043.897915:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+45:11249:x1870607923847040:12345-192.168.202.33@tcp:36:truncate.0 Request processed in 1158us (1403us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783951043.897926:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00000020:00080000:1.0:1783951043.897933:0:11194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783951044.023322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.023601:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923847168 00000100:00100000:2.0:1783951044.023616:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923847168 00000100:00100000:2.0:1783951044.023708:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:2.0:1783951044.023723:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+45:11263:x1870607923847168:12345-192.168.202.33@tcp:101:stat.0 00010000:00010000:2.0:1783951044.023757:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951044.023784:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f84ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f5fc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.023887:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.023906:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.023930:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.023964:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.023973:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.023981:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024088:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024099:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024107:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951044.024376:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1783951044.024382:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951044.024410:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024425:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024435:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024443:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024463:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024470:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.024476:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024485:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024501:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951044.024505:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.024510:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024517:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f84d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024534:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024541:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024547:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024552:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.024555:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024574:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024582:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:2.0:1783951044.024585:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.024588:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024595:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f84d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024630:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f84ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024645:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.024654:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951044.024656:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951044.024659:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608c00, rc 0) 00000100:00100000:2.0:1783951044.024757:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+46:11263:x1870607923847168:12345-192.168.202.33@tcp:101:stat.0 Request processed in 1038us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.024766:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00080000:1.0:1783951044.025521:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951044.119358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.119517:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923847424 00000100:00100000:3.0:1783951044.119532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923847424 00000100:00100000:3.0:1783951044.119622:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:3.0:1783951044.119635:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+46:11273:x1870607923847424:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951044.119662:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951044.119689:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f84e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f603 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951044.119833:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783951044.119991:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f84e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f603 expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.120128:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:3.0:1783951044.120131:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951044.120138:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f84e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f603 expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.120211:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145000, rc 0) 00000100:00100000:3.0:1783951044.120326:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:11273:x1870607923847424:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 693us (992us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1783951044.120486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:0.0:1783951044.127441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.127551:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923847680 00000100:00100000:1.0:1783951044.127565:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923847680 00000100:00100000:1.0:1783951044.127637:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:1.0:1783951044.127649:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:11273:x1870607923847680:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1783951044.128553:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+48:11273:x1870607923847680:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 898us (1118us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1783951044.128566:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:1.0:1783951044.192790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.193111:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923847936 00000100:00100000:0.0:1783951044.193124:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923847936 00000100:00100000:0.0:1783951044.193253:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:0.0:1783951044.193276:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+48:11279:x1870607923847936:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951044.193310:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951044.193343:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f84f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f60a expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.193506:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.193526:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.193537:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.193584:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.193599:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 49 pid: 6527 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.193616:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944906368:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951044.193750:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03513350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951044.201654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.201762:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923848064 00000100:00100000:1.0:1783951044.201774:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923848064 00010000:00010000:1.0:1783951044.201829:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 50 pid: 6527 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951044.201889:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1783951044.201900:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+50:2407:x1870607923848064:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951044.201923:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951044.201932:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 50 pid: 6527 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.201947:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 50 pid: 6527 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.202210:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951044.202218:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.202232:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.202241:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.202279:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951044.202467:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+50:2407:x1870607923848064:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 566us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951044.202475:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00010000:00010000:0.0:1783951044.203274:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f84df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5fc expref: 49 pid: 6527 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.203300:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944906368:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951044.203329:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.203360:0:11194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.203367:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951044.203394:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783951044.203580:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f84f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 50 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.203598:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 49 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.203606:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951044.203610:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783951044.203613:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951044.203674:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:11279:x1870607923847936:12345-192.168.202.33@tcp:101:bash.0 Request processed in 10401us (10900us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783951044.203684:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:2.0:1783951044.207757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.207863:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923848320 00000100:00100000:3.0:1783951044.207877:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923848320 00000100:00100000:3.0:1783951044.207962:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:3.0:1783951044.207976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:11279:x1870607923848320:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:3.0:1783951044.208394:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.208418:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.208433:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951044.208497:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1783951044.208526:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ebba61f reply state 00000000fc51efc5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.208542:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.208552:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951044.208555:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951044.208559:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951044.208698:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:11279:x1870607923848320:12345-192.168.202.33@tcp:36:bash.0 Request processed in 724us (957us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1783951044.208707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00000020:00080000:3.0:1783951044.208713:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783951044.215304:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.215610:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923848448 00000100:00100000:0.0:1783951044.215626:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923848448 00000100:00100000:0.0:1783951044.215710:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:0.0:1783951044.215723:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024792ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:11279:x1870607923848448:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951044.215758:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951044.215786:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8510 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f611 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.215969:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.215988:0:10105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 53 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.216011:0:10105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.216058:0:10105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 53 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.216074:0:10105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 53 pid: 11194 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.216093:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944906496:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951044.217056:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03513350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951044.219512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.219669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923848576 00000100:00100000:2.0:1783951044.219682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923848576 00010000:00010000:2.0:1783951044.219749:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 54 pid: 11194 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951044.219800:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:2.0:1783951044.219810:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:2407:x1870607923848576:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951044.219831:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951044.219839:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 54 pid: 11194 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.219865:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 54 pid: 11194 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.219892:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951044.219898:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.219912:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.219922:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.219946:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951044.220021:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:2407:x1870607923848576:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 211us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.220030:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00010000:00010000:0.0:1783951044.220787:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f84fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f60a expref: 53 pid: 11194 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.220819:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944906496:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951044.220871:0:10105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.220883:0:10105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.220913:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951044.221077:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783951044.221083:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951044.221110:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.221296:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8510 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f611 expref: 53 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.221315:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f611 expref: 52 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.221324:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951044.221327:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951044.221331:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d600, rc 0) 00000100:00100000:0.0:1783951044.221409:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024792ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:11279:x1870607923848448:12345-192.168.202.33@tcp:101:bash.0 Request processed in 5688us (6119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.221417:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1783951044.225879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.226019:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923848832 00000100:00100000:0.0:1783951044.226034:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923848832 00000100:00100000:0.0:1783951044.226111:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:0.0:1783951044.226124:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03494c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:11279:x1870607923848832:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:0.0:1783951044.226731:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03494c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:11279:x1870607923848832:12345-192.168.202.33@tcp:35:bash.0 Request processed in 606us (865us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783951044.226744:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1783951044.313700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.313870:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923849088 00000100:00100000:0.0:1783951044.313883:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923849088 00000100:00100000:0.0:1783951044.313961:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:0.0:1783951044.313974:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:11289:x1870607923849088:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951044.314021:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951044.314050:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f851e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f618 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951044.314232:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783951044.314611:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f851e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f618 expref: 55 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.314629:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:0.0:1783951044.314633:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951044.314639:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f851e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f618 expref: 55 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.314658:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5da00, rc 0) 00000100:00100000:0.0:1783951044.314792:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11289:x1870607923849088:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 819us (1107us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1783951044.314802:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:2.0:1783951044.318810:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.318973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923849216 00000100:00100000:3.0:1783951044.318986:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923849216 00000100:00100000:3.0:1783951044.319214:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:3.0:1783951044.319227:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11289:x1870607923849216:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:3.0:1783951044.319541:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319565:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319580:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319595:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319602:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319609:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319714:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319723:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319731:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951044.319797:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319832:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319838:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319914:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319921:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.319925:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319933:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319947:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951044.319950:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.319955:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319962:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f852c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319978:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319984:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.319990:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320014:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.320018:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320024:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320033:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:3.0:1783951044.320036:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.320038:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320043:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8533 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320053:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320059:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320065:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320069:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.320072:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320077:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320095:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951044.320097:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.320099:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.320106:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f853a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951044.320476:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11289:x1870607923849216:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 1247us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.320486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:2.0:1783951044.323608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.323753:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923849472 00000100:00100000:3.0:1783951044.323766:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923849472 00000100:00100000:3.0:1783951044.323837:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:3.0:1783951044.323921:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11289:x1870607923849472:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1783951044.324560:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:11289:x1870607923849472:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 641us (964us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1783951044.324570:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:0.0:1783951044.380931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.381243:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923849728 00000100:00100000:3.0:1783951044.381270:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923849728 00000100:00100000:3.0:1783951044.381454:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:3.0:1783951044.381478:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:11292:x1870607923849728:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951044.381513:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951044.381544:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8541 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f61f expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381639:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381674:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381690:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381704:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381711:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381717:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381896:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8556 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381906:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.381915:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951044.381928:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783951044.382047:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382056:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382062:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382077:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.382082:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382090:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382105:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951044.382109:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.382114:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382120:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8548 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382138:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382206:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382211:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382216:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.382218:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382225:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382244:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:3.0:1783951044.382247:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.382250:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382256:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f854f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382304:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8541 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f61f expref: 58 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382319:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8556 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f61f expref: 57 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.382328:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951044.382331:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951044.382333:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9e00, rc 0) 00000100:00100000:3.0:1783951044.383686:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:11292:x1870607923849728:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 2203us (2760us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1783951044.383699:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:2.0:1783951044.391754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.393120:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923849856 00000100:00100000:0.0:1783951044.393136:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923849856 00000100:00100000:0.0:1783951044.393273:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:0.0:1783951044.393299:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:11292:x1870607923849856:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:0.0:1783951044.393398:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393439:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393454:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393507:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393516:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393524:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393531:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951044.393536:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393546:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393561:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951044.393565:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951044.393569:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.393577:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8564 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.393933:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:11292:x1870607923849856:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 647us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.393949:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:2.0:1783951044.394046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.394094:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923849984 00000100:00100000:3.0:1783951044.394102:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923849984 00000100:00100000:0.0:1783951044.394195:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:0.0:1783951044.394206:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:2408:x1870607923849984:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951044.394221:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951044.394241:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8556 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f61f expref: 57 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.394255:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:0.0:1783951044.394260:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951044.394663:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:2408:x1870607923849984:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.394673:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1783951044.398577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.398754:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923850240 00000100:00100000:3.0:1783951044.398766:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923850240 00000100:00100000:3.0:1783951044.398855:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:3.0:1783951044.398867:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:11292:x1870607923850240:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1783951044.399237:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:11292:x1870607923850240:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 372us (674us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1783951044.399263:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:1.0:1783951044.533455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.533653:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923850496 00000100:00100000:3.0:1783951044.533667:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923850496 00000100:00100000:3.0:1783951044.533790:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:3.0:1783951044.533805:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:11310:x1870607923850496:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:3.0:1783951044.533840:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951044.533870:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f856b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f626 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.534037:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8572 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.534056:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8572 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.534070:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8572 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951044.534084:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783951044.534283:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f856b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f626 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.534306:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8572 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f626 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.534316:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951044.534320:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783951044.534324:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8e00, rc 0) 00000100:00100000:3.0:1783951044.534678:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11310:x1870607923850496:12345-192.168.202.33@tcp:101:cat.0 Request processed in 876us (1549us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1783951044.534687:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:1.0:1783951044.562576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.562677:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923850624 00000100:00100000:3.0:1783951044.562689:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923850624 00000100:00100000:3.0:1783951044.562797:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 75 00000100:00100000:3.0:1783951044.562811:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11311:x1870607923850624:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951044.562855:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951044.562891:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f62d expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.564700:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.564729:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.564745:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951044.564826:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783951044.564832:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951044.565647:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.565695:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f62d expref: 61 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.565724:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f62d expref: 60 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.565733:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951044.565736:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951044.565740:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609e00, rc 0) 00000100:00100000:2.0:1783951044.565862:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11311:x1870607923850624:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 3053us (3293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.565872:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 75 00000100:00100000:1.0:1783951044.575240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.575314:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851008 00000100:00100000:3.0:1783951044.575328:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851008 00000100:00100000:3.0:1783951044.575517:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:3.0:1783951044.575531:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11311:x1870607923851008:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1783951044.576075:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11311:x1870607923851008:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 545us (846us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1783951044.576092:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951044.580656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.580832:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851136 00000100:00100000:2.0:1783951044.580844:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851136 00000100:00100000:2.0:1783951044.581014:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1783951044.581027:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11311:x1870607923851136:12345-192.168.202.33@tcp:103:lfs.0 00010000:00010000:2.0:1783951044.581047:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783951044.581310:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8517 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f611 expref: 61 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.581340:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8572 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f626 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.581354:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8414 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5cb expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.581365:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951044.581371:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951044.581499:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11311:x1870607923851136:12345-192.168.202.33@tcp:103:lfs.0 Request processed in 474us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.581508:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:1.0:1783951044.583284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.583367:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851264 00000100:00100000:0.0:1783951044.583379:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851264 00000100:00100000:0.0:1783951044.583444:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:0.0:1783951044.583455:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11311:x1870607923851264:12345-192.168.202.33@tcp:58:lfs.0 00010000:00010000:0.0:1783951044.583625:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.583647:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.583661:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951044.584587:0:11194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951044.584764:0:11194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783951044.585049:0:11194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783951044.585407:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11311:x1870607923851264:12345-192.168.202.33@tcp:58:lfs.0 Request processed in 1948us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.585420:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:3.0:1783951044.604567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.604738:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851392 00000100:00100000:2.0:1783951044.604752:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851392 00000100:00100000:2.0:1783951044.604845:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 77 00000100:00100000:2.0:1783951044.604859:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11313:x1870607923851392:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951044.605346:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951044.605377:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8595 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f634 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605461:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605499:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605513:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605526:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605534:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605541:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605639:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605650:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605658:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951044.605720:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783951044.605726:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951044.605752:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.605767:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606627:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606635:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606643:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606649:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.606654:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606662:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606679:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951044.606682:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.606687:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606694:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f859c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606713:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606719:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606725:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606739:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.606743:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606750:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606758:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:2.0:1783951044.606760:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.606763:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.606769:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.607133:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8595 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.607359:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.607368:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951044.607371:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951044.607374:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609000, rc 0) 00000100:00100000:3.0:1783951044.608725:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11313:x1870607923851392:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 3856us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.608741:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 77 00010000:00010000:0.0:1783951044.704729:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951044.706308:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951044.706320:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951044.706367:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783951044.706378:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783951044.706563:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248011f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944906624:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783951044.706795:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951044.731010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.731054:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851520 00000100:00100000:2.0:1783951044.731070:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851520 00000100:00100000:2.0:1783951044.731175:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:2.0:1783951044.731949:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923851520:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951044.732032:0:6526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951044.732917:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923851520:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 1725us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.732931:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:3.0:1783951044.734082:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248011f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944906624:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951044.749303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.749826:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851648 00000100:00100000:3.0:1783951044.749840:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851648 00000100:00100000:3.0:1783951044.750096:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:3.0:1783951044.750126:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11324:x1870607923851648:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.750267:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.750287:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.750300:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759058:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759080:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759094:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759132:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759159:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759167:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951044.759230:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783951044.759234:0:11194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951044.759249:0:11194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759261:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759287:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759295:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759301:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.759306:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759314:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759328:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:2.0:1783951044.759331:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.759335:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759342:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f85b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759359:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759365:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759371:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759376:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.759384:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759391:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759398:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9e0247827c00) 00010000:00010000:2.0:1783951044.759400:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.759403:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759408:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759421:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759426:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759432:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759437:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951044.759439:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759446:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759453:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:2.0:1783951044.759455:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951044.759463:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.759469:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f85bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951044.759556:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11324:x1870607923851648:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 9429us (10263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.759566:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:2.0:1783951044.765874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.766056:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923851904 00000100:00100000:3.0:1783951044.766066:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923851904 00000100:00100000:3.0:1783951044.766133:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 80 00000100:00100000:3.0:1783951044.766158:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11324:x1870607923851904:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.766180:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951044.766200:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f63b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766310:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766326:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766338:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951044.766349:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783951044.766426:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766450:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766457:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766464:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.766468:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766475:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766486:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951044.766489:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951044.766493:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766499:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766670:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85c6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f63b expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766684:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:3.0:1783951044.766686:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951044.766691:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f63b expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.766702:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9000, rc 0) 00000100:00100000:3.0:1783951044.766764:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923851904:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 622us (900us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1783951044.766772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 80 00000100:00100000:2.0:1783951044.772545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.772713:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923852032 00000100:00100000:3.0:1783951044.772725:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923852032 00000100:00100000:3.0:1783951044.772808:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:3.0:1783951044.772828:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923852032:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783951044.772878:0:10105:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783951044.773266:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923852032:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 447us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.773276:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:2.0:1783951044.776085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.776211:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923852288 00000100:00100000:0.0:1783951044.776225:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923852288 00000100:00100000:0.0:1783951044.776302:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:0.0:1783951044.776315:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923852288:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951044.776343:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951044.776347:0:11194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783951044.776383:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f62d expref: 60 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.776407:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951044.776413:0:11194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951044.776431:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f85db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f642 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951044.780114:0:11194:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783951044.780528:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.780551:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.780565:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.780658:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f85db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f642 expref: 62 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.780684:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f642 expref: 61 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.780695:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827c00) 00010000:00010000:2.0:1783951044.780699:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951044.780720:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608200, rc 0) 00000100:00100000:2.0:1783951044.783618:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11324:x1870607923852288:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 7290us (7531us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1783951044.783633:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:2.0:1783951044.792970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.793218:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923852544 00000100:00100000:3.0:1783951044.793233:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923852544 00000100:00100000:3.0:1783951044.793313:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 83 00000100:00100000:3.0:1783951044.793325:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11324:x1870607923852544:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.793486:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951044.793522:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f85e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f642 expref: 61 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.793545:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827c00) 00010000:00010000:3.0:1783951044.793558:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951044.793589:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.793604:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.793616:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795274:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795299:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795312:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795375:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795383:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795390:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795396:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.795400:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795407:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795419:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951044.795423:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.795428:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795434:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f85f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795481:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795488:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795494:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795500:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.795503:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795508:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795517:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x63003720 (ffff9e024109e700) 00010000:00010000:3.0:1783951044.795520:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951044.795523:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.795529:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f85f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x63003720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951044.795652:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923852544:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 2324us (2691us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951044.795662:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 83 00000100:00100000:1.0:1783951044.799290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.799380:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923852672 00000100:00100000:2.0:1783951044.799397:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923852672 00000100:00100000:2.0:1783951044.799478:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00100000:2.0:1783951044.799493:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11324:x1870607923852672:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951044.799521:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951044.799550:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f85fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f649 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.800757:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.800792:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.800808:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.803361:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f85fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.803396:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.803407:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:2.0:1783951044.803433:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783951044.803438:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608e00, rc 0) 00000100:00100000:3.0:1783951044.804424:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11324:x1870607923852672:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 4923us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.804455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00100000:2.0:1783951044.818979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.819702:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923852928 00000100:00100000:3.0:1783951044.819714:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923852928 00000100:00100000:3.0:1783951044.819778:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 85 00000100:00100000:3.0:1783951044.819795:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11324:x1870607923852928:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.820119:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.820317:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.820336:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951044.820644:0:11194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1783951044.820658:0:11194:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400468514885ns, next at 401468511938ns, rc = 0 00000004:00010000:3.0:1783951044.820718:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c008e3fe reply state 00000000d85312ae transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.820732:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.820740:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:3.0:1783951044.820743:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783951044.820747:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951044.821338:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:11324:x1870607923852928:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1546us (2363us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1783951044.821348:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 85 00000100:00100000:3.0:1783951044.824689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.825209:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923853056 00000100:00100000:0.0:1783951044.825226:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923853056 00000100:00100000:0.0:1783951044.825310:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 86 00000100:00100000:0.0:1783951044.825329:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:11324:x1870607923853056:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951044.825366:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951044.825405:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f650 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.825501:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.825518:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.825541:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:0.0:1783951044.825545:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951044.825550:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951044.825632:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:11324:x1870607923853056:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 310us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.825641:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 86 00000100:00100000:3.0:1783951044.831040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.831499:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923853184 00000100:00100000:1.0:1783951044.831516:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923853184 00000100:00100000:1.0:1783951044.831592:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1783951044.831603:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870607923853184:12345-192.168.202.33@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783951044.831649:0:9851:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1783951044.831718:0:9851:0:(genops.c:1406:class_connect()) connect: client 75392fba-af18-4ae6-9b8a-6f1db7dcbeed, cookie 0x7645c8e1169f861a 00002000:00100000:1.0:1783951044.831734:0:9851:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75392fba-af18-4ae6-9b8a-6f1db7dcbeed/ffff9e0248101000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951044.831761:0:9851:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951044.831866:0:9851:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783951044.831905:0:9851:0:(import.c:65:import_set_state_nolock()) ffff9e0248106000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951044.832034:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2406:x1870607923853184:12345-192.168.202.33@tcp:8:lhsmtool_posix.0 Request processed in 430us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951044.832044:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:2.0:1783951044.843112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.843314:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923853312 00000100:00100000:0.0:1783951044.843333:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923853312 00000100:00100000:0.0:1783951044.843456:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:0.0:1783951044.843471:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:0:x1870607923853312:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783951044.844073:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783951044.847503:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1783951044.847520:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000100:00100000:1.0:1783951044.850235:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:0:x1870607923853312:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 6748us (7109us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783951044.850256:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:2.0:1783951044.856131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.856304:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923853568 00000100:00100000:1.0:1783951044.856317:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923853568 00000100:00100000:1.0:1783951044.856383:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783951044.856394:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:11324:x1870607923853568:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783951044.856664:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:11324:x1870607923853568:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 272us (547us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1783951044.856673:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:2.0:1783951044.869071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.872116:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923853824 00000100:00100000:3.0:1783951044.872136:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923853824 00000100:00100000:2.0:1783951044.878500:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 87 00000100:00100000:2.0:1783951044.878516:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:11324:x1870607923853824:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783951044.878696:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:11324:x1870607923853824:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 183us (9637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.878705:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 87 00000100:00100000:2.0:1783951044.889087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.894965:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923853952 00000100:00100000:3.0:1783951044.894986:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923853952 00000100:00100000:3.0:1783951044.895106:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:3.0:1783951044.895120:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:11324:x1870607923853952:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.895173:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951044.895809:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8621 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f657 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.896045:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.896062:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.896077:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951044.896172:0:11194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951044.897137:0:11194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.897584:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8621 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f657 expref: 67 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.897606:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f657 expref: 66 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.897628:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:3.0:1783951044.897631:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951044.897635:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8400, rc 0) 00000100:00100000:3.0:1783951044.897744:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:11324:x1870607923853952:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 2626us (8670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.897754:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:2.0:1783951044.903377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.903675:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854080 00000100:00100000:1.0:1783951044.903707:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854080 00000100:00100000:1.0:1783951044.904135:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:1.0:1783951044.904193:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923854080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951044.904219:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951044.904251:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f65e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951044.904285:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54eec4, blocks: 0x0 00010000:00010000:1.0:1783951044.904310:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1783951044.904316:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951044.904328:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.904351:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.904367:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66a00, rc 0) 00000100:00100000:1.0:1783951044.904439:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923854080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 260us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951044.904447:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:0.0:1783951044.906769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.906815:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854336 00000100:00100000:3.0:1783951044.906826:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854336 00000100:00100000:3.0:1783951044.907423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:3.0:1783951044.907437:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:11324:x1870607923854336:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783951044.907570:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:11324:x1870607923854336:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 138us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.907577:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:2.0:1783951044.915023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951044.915182:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854464 00000100:00100000:0.0:1783951044.915196:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854464 00000100:00100000:0.0:1783951044.915277:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:0.0:1783951044.915289:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:11324:x1870607923854464:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951044.915316:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951044.915346:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f665 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.915408:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.915418:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951044.915423:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951044.915429:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.915473:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951044.915489:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 7 pid: 8441 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.915506:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944906752:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951044.915620:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951044.920270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.920346:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854592 00000100:00100000:3.0:1783951044.920358:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854592 00010000:00010000:3.0:1783951044.920414:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 8 pid: 8441 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951044.920469:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:3.0:1783951044.920480:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923854592:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951044.920499:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951044.920528:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 8 pid: 8441 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.920556:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 8 pid: 8441 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.920588:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951044.920593:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951044.920603:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.920613:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.920659:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951044.920688:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1870607944906880:192.168.202.33@tcp:105: 00000100:00100000:3.0:1783951044.920791:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3600 going to sleep for 11 seconds 00010000:00010000:2.0:1783951044.921726:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f862f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f65e expref: 8 pid: 8441 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951044.921752:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944906752:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951044.921784:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951044.921798:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c400, rc 0) 00000100:00100000:2.0:1783951044.922443:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11324:x1870607923854464:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 7153us (7432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951044.922454:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:3.0:1783951044.925926:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1870607944906880:192.168.202.33@tcp:105: 00010000:00010000:3.0:1783951044.925971:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951044.926132:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923854592:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 5652us (5875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951044.926159:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:3.0:1783951044.930746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.931065:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854720 00000100:00100000:1.0:1783951044.931078:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854720 00002000:00100000:1.0:1783951044.931384:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9e0247a2b480 x1870607923854720/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:60/0 lens 504/0 e 0 to 0 dl 1783951055 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951044.931399:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0247a2b480 with x1870607923854720 ext(0->8) 00002000:00010000:1.0:1783951044.931406:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0247a2b480 00000100:00100000:1.0:1783951044.931495:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:1.0:1783951044.931508:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923854720:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783951044.935863:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2410:x1870607923854720:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 Request processed in 4347us (5181us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783951044.935887:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00002000:00100000:1.0:1783951044.936034:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9e0247a2b480 x1870607923854720/t4294967303(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:60/0 lens 504/448 e 0 to 0 dl 1783951055 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951044.936046:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0247a2b480 with x1870607923854720 ext(0->8) 00002000:00010000:1.0:1783951044.936052:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0247a2b480 00000100:00100000:1.0:1783951044.938470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.938565:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854848 00000100:00100000:2.0:1783951044.938582:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854848 00000100:00100000:2.0:1783951044.938667:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 90 00000100:00100000:2.0:1783951044.939093:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:11324:x1870607923854848:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783951044.952380:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1783951044.952397:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1783951044.952471:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1783951044.952493:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e0351335180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1783951044.952499:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0247a54200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e0351335e40 00000020:00080000:2.0:1783951044.952503:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0247a54600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e037797d400 00000100:00100000:0.0:1783951044.952613:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783951044.952629:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952643:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.952647:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944907008:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783951044.952659:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952668:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.952673:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952681:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952700:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e024782e800) 00010000:00010000:1.0:1783951044.952704:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951044.952723:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952732:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8350 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952759:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.952766:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951044.952778:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952786:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952792:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.952795:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952801:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952825:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:1.0:1783951044.952830:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951044.952840:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952848:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8357 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.952871:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944907008 00010000:00010000:1.0:1783951044.952879:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.952891:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944907008 00010000:00010000:1.0:1783951044.952912:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952920:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952926:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5de00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.952929:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952936:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952947:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e900) 00010000:00010000:1.0:1783951044.952951:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951044.952954:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.952961:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8396 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.952984:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1783951044.952989:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953007:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951044.953013:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944907008:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783951044.953025:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953033:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.953042:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953049:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953059:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951044.953062:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951044.953065:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953072:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f84a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953084:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953090:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953097:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953102:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.953105:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953111:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953117:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951044.953119:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951044.953129:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953135:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f84c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953192:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953200:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953206:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953211:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.953214:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953219:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953227:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951044.953229:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951044.953232:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953238:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8509 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953248:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953253:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953264:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953269:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951044.953272:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953277:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953283:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:1.0:1783951044.953285:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783951044.953288:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.953293:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f860c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951044.953664:0:9851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00000020:00080000:3.0:1783951044.953786:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00002000:00010000:0.0:1783951044.954031:0:9851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783951044 00002000:00010000:0.0:1783951044.954035:0:9851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783951044.954037:0:9851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783951044 -> 1783951044 00002000:00010000:0.0:1783951044.954040:0:9851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:3.0:1783951044.954311:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783951044.954479:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944907008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1481us (1712us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783951044.954492:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1783951044.954538:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951044.954543:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951044.954566:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944907136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951044.954640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951044.954711:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:11324:x1870607923854848:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 15621us (16246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.954723:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 90 00000100:00100000:3.0:1783951044.954825:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944907136 00000100:00100000:3.0:1783951044.954839:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944907136 00000100:00100000:3.0:1783951044.955383:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783951044.955394:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607944907136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783951044.955421:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1783951044.955454:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a54eec2, atime: 0x6a54eec3, ctime: 0x6a54eec2, blocks: 0x8 00010000:00010000:3.0:1783951044.955462:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.955478:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1783951044.955482:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951044.955489:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.955507:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.955516:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.955525:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.955541:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951044.955613:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951044.955620:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.955629:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951044.955633:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.955642:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.955674:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.955682:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000871a10f2/0x7645c8e1169f863d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.955702:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951044.955704:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951044.955706:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783951044.955743:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e037fbbfb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1783951044.955751:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944907008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1783951044.956234:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0247a2a300/2, rc 0, transno 4294967302 00000100:00100000:0.0:1783951044.956247:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944907136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783951044.956308:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944907136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 749us (1503us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783951044.956318:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951044.960058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.964075:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923854976 00000100:00100000:1.0:1783951044.964089:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923854976 00000100:00100000:1.0:1783951044.964202:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:1.0:1783951044.964214:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923854976:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783951044.971950:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1783951044.971964:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1783951044.972086:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923854976:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 7868us (12031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951044.974646:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:0.0:1783951044.979233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.979364:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923855232 00000100:00100000:3.0:1783951044.979375:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923855232 00000100:00100000:3.0:1783951044.979453:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 91 00000100:00100000:3.0:1783951044.979464:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:11324:x1870607923855232:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.979522:0:11194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951044.979549:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f8628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f657 expref: 14 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.979569:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:3.0:1783951044.979574:0:11194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951044.979603:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.979617:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.979628:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951044.979758:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c016d540 reply state 0000000063206a8f transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.979771:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.979777:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:3.0:1783951044.979780:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951044.979782:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951044.980002:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:11324:x1870607923855232:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 530us (771us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1783951044.980027:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 91 00000100:00100000:1.0:1783951044.982350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951044.982519:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923855360 00000100:00100000:2.0:1783951044.982528:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923855360 00000100:00100000:2.0:1783951044.982604:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:2.0:1783951044.982613:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923855360:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783951044.982762:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783951044.982766:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1783951044 -> 1783951044 00002000:00010000:2.0:1783951044.982769:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783951043 00002000:00010000:2.0:1783951044.982771:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783951044 -> 1783951044 00002000:00010000:2.0:1783951044.982774:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783951044.982828:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923855360:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 216us (487us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783951044.982836:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:2.0:1783951044.984777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951044.985262:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923855616 00000100:00100000:3.0:1783951044.985271:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923855616 00000100:00100000:3.0:1783951044.985326:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 92 00000100:00100000:3.0:1783951044.985335:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:11324:x1870607923855616:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783951044.985398:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.985415:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.985425:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.985466:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 15 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.985479:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 15 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951044.985493:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944907264:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951044.985578:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951044.987368:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944907264:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951044.987399:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951044.990266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951044.990360:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923855744 00000100:00100000:1.0:1783951044.990369:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923855744 00010000:00010000:1.0:1783951044.990407:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 16 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951044.990457:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:1.0:1783951044.990466:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:2407:x1870607923855744:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951044.990483:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951044.990490:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 16 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.990517:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 16 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.990540:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8605 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f649 expref: 16 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.990557:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:1.0:1783951044.990563:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.990573:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.990581:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951044.990607:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951044.990659:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:2407:x1870607923855744:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 194us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951044.990667:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00010000:00010000:3.0:1783951044.991592:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.991614:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.991658:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.991667:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.991675:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.991682:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951044.992330:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.992340:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.992356:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:3.0:1783951044.992359:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783951044.992363:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951044.992370:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f864b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951044.992702:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:11324:x1870607923855616:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 Request processed in 7366us (7930us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783951044.992709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 92 00000100:00100000:2.0:1783951045.011592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.013517:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923855872 00000100:00100000:0.0:1783951045.013530:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923855872 00000100:00100000:0.0:1783951045.013592:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:0.0:1783951045.013602:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2410:x1870607923855872:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783951045.013644:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.013667:0:9851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.013683:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951045.013688:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951045.013693:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.013743:0:9851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.013757:0:9851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 7 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.013771:0:9851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9851:1870607944907392:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951045.013867:0:9851:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03513350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951045.023222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.023278:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923856000 00000100:00100000:0.0:1783951045.023287:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923856000 00010000:00010000:0.0:1783951045.023328:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 8 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.023365:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:0.0:1783951045.023374:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923856000:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951045.023390:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951045.023413:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 8 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.023441:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 8 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.023466:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951045.023470:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951045.023476:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.023485:0:10402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.023503:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951045.023557:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923856000:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 183us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.023565:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00010000:00010000:3.0:1783951045.024167:0:9851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f8636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f665 expref: 7 pid: 8439 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.024183:0:9851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9851:1870607944907392:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951045.024204:0:9851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024215:0:9851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024223:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024245:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024253:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024260:0:9851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024267:0:9851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951045.024271:0:9851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024293:0:9851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024306:0:9851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.024312:0:9851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080645f29/0x7645c8e1169f8652 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.024366:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2410:x1870607923855872:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 10766us (12783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.024375:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:0.0:1783951045.027064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.027180:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923856256 00000100:00100000:3.0:1783951045.027190:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923856256 00000100:00100000:3.0:1783951045.027246:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 93 00000100:00100000:3.0:1783951045.027256:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:11324:x1870607923856256:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783951045.027340:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.027358:0:10105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.027368:0:10105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.027401:0:10105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.027421:0:10105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 14 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.027434:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944907520:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951045.027503:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951045.030303:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944907520:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951045.030339:0:10105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.033223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.033392:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923856384 00000100:00100000:3.0:1783951045.033402:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923856384 00010000:00010000:3.0:1783951045.033444:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 15 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.033487:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:3.0:1783951045.033800:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:2407:x1870607923856384:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951045.033820:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951045.033828:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 15 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.033842:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 15 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.033863:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f8499 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f5ee expref: 15 pid: 6527 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.034305:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951045.034313:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.034335:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.034343:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.036004:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951045.036087:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:2407:x1870607923856384:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 2585us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.036098:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00010000:00010000:0.0:1783951045.043349:0:10105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.043366:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.044496:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.044522:0:10105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.044531:0:10105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.044585:0:10105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.044600:0:10105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 14 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951045.044617:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944907648:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951045.045124:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951045.066874:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944907648:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951045.066910:0:10105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951045.070269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.070375:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923856512 00000100:00100000:0.0:1783951045.070386:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923856512 00010000:00010000:0.0:1783951045.070430:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 15 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.070482:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:0.0:1783951045.070494:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:2408:x1870607923856512:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951045.070510:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951045.070517:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 15 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.070530:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 15 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.070553:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8613 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f650 expref: 15 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.070570:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:0.0:1783951045.070576:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.070588:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.070596:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.070630:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951045.070701:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:2408:x1870607923856512:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 208us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.070709:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00010000:00010000:1.0:1783951045.070780:0:10105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.070788:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951045.070927:0:10105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1783951045.071066:0:10105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1783951045.071109:0:10105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1783951045.071240:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10105:1870607944907776:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783951045.071291:0:10105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951045.071315:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951045.071723:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944907776 00000100:00100000:0.0:1783951045.071729:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944907776 00000100:00100000:0.0:1783951045.071772:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783951045.071780:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10105:x1870607944907776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783951045.071881:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10105:x1870607944907776:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.071890:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783951045.072025:0:10105:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783951045.072031:0:10105:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e037fbbfb80, transno 4294967304 00000100:00100000:3.0:1783951045.072052:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10105:1870607944907776:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783951045.072268:0:10105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1783951045.072323:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10105:1870607944907904:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783951045.072354:0:10105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951045.072382:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342972cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951045.072450:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944907904 00000100:00100000:2.0:1783951045.072454:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944907904 00000100:00100000:2.0:1783951045.072491:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783951045.072499:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10105:x1870607944907904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783951045.072597:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10105:x1870607944907904:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (242us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783951045.072603:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783951045.072680:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10105:1870607944907904:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783951045.072714:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072723:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072731:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072738:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.072755:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072763:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072777:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:3.0:1783951045.072780:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951045.072785:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072792:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8660 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072833:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072841:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072847:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072852:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.072855:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072862:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072870:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951045.072873:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951045.072882:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072888:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f858e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072937:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072952:0:10105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072960:0:10105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.072985:0:10105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.073010:0:10105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 17 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.073021:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944908032:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951045.073085:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342972600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951045.077492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951045.077523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923856640 00000100:00100000:1.0:1783951045.077539:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923856640 00010000:00010000:1.0:1783951045.077574:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 18 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951045.077606:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:1.0:1783951045.077614:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2408:x1870607923856640:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951045.077628:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951045.077634:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 18 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.077647:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 18 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.077669:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:1.0:1783951045.077675:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.077685:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.077693:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.077710:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951045.077754:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2408:x1870607923856640:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 140us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951045.077762:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00010000:00010000:3.0:1783951045.079061:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f85aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f634 expref: 17 pid: 6524 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.079084:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944908032:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951045.079111:0:10105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079133:0:10105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079153:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079168:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079175:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079182:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079188:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.079193:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079200:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079215:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951045.079218:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951045.079222:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079227:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f8667 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079238:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079250:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079255:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079259:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.079262:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079267:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079275:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024782ec00) 00010000:00010000:3.0:1783951045.079277:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951045.079280:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.079286:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8659 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.079453:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11324:x1870607923856256:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 52197us (52395us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1783951045.079462:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 93 00000020:00080000:3.0:1783951045.079468:0:10105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783951045.081833:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951045.081842:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951045.081870:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783951045.081879:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783951045.090074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.093242:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923856896 00000100:00100000:0.0:1783951045.093253:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923856896 00000100:00100000:0.0:1783951045.093351:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951045.093361:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11324:x1870607923856896:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783951045.093617:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783951045.093648:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1783951045.093678:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.093694:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.093705:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.093714:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.093721:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.093734:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.093752:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783951045.093858:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:11324:x1870607923856896:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 498us (3795us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1783951045.093867:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000020:00080000:0.0:1783951045.093872:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783951045.097212:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951045.097224:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.097235:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951045.097239:0:9537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.097248:0:9537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.097267:0:9537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:1.0:1783951045.097271:0:9537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951045.097276:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.097282:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f866e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.097296:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951045.097298:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951045.097300:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951045.440479:0:14216:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951045.440488:0:14216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951045.440528:0:14216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783951045.440537:0:14216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951045.575311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.575356:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923857152 00000100:00100000:3.0:1783951045.575364:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923857152 00000100:00100000:3.0:1783951045.575419:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 94 00000100:00100000:3.0:1783951045.575430:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:11334:x1870607923857152:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951045.575456:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951045.575476:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f66c expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.575590:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f867c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.575604:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f867c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.575619:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f867c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951045.575630:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783951045.575743:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f66c expref: 21 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.575762:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f867c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f66c expref: 20 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.575772:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951045.575775:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951045.575778:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8e00, rc 0) 00000100:00100000:3.0:1783951045.575833:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11334:x1870607923857152:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 404us (531us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1783951045.575851:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 94 00000100:00100000:2.0:1783951045.581349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.581417:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923857280 00000100:00100000:3.0:1783951045.581428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923857280 00000100:00100000:3.0:1783951045.581489:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 95 00000100:00100000:3.0:1783951045.581500:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11334:x1870607923857280:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:3.0:1783951045.581574:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.581592:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.581604:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.581620:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.581627:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.581634:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.581718:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584011:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584027:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951045.584118:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584135:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584157:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584165:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584171:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.584175:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584182:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584195:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951045.584198:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951045.584202:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584208:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f868a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584226:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584232:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584245:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584250:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.584253:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584260:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584268:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024109ef00) 00010000:00010000:3.0:1783951045.584270:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951045.584273:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584278:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8691 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584294:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584300:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584306:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584311:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.584314:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584329:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584337:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109e800) 00010000:00010000:3.0:1783951045.584340:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951045.584343:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.584349:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8698 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.584439:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11334:x1870607923857280:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 2936us (3093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.584449:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 95 00000100:00100000:1.0:1783951045.622865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.623012:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923857536 00000100:00100000:3.0:1783951045.623022:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923857536 00000100:00100000:3.0:1783951045.623091:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 96 00000100:00100000:3.0:1783951045.623103:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11337:x1870607923857536:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951045.623123:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951045.623164:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f869f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f673 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623235:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623251:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623262:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623294:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623302:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623310:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623435:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623444:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623452:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951045.623461:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783951045.623673:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623682:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623689:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623697:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.623702:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623794:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623809:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951045.623812:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951045.623817:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623824:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f86a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623837:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623843:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623849:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623855:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.623857:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623863:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623870:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024109e800) 00010000:00010000:3.0:1783951045.623873:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951045.623876:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623892:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f86ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623935:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f869f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 23 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623948:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 22 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.623955:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:3.0:1783951045.623957:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951045.623959:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144000, rc 0) 00000100:00100000:3.0:1783951045.624085:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11337:x1870607923857536:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 984us (1230us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783951045.624093:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 96 00000100:00100000:3.0:1783951045.639047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.639081:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923857664 00000100:00100000:3.0:1783951045.639090:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923857664 00000100:00100000:3.0:1783951045.639164:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00100000:3.0:1783951045.639175:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11337:x1870607923857664:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:3.0:1783951045.639241:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639258:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639271:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639317:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639325:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639332:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639338:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951045.639343:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639351:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639363:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:3.0:1783951045.639366:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951045.639371:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.639377:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f86c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.639444:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11337:x1870607923857664:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 271us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.639452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00100000:3.0:1783951045.641864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.641897:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923857920 00000100:00100000:3.0:1783951045.641907:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923857920 00000100:00100000:3.0:1783951045.641971:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:3.0:1783951045.641980:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03494c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11337:x1870607923857920:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1783951045.642211:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03494c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:11337:x1870607923857920:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 231us (354us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1783951045.642220:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:3.0:1783951045.679493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.681911:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923858176 00000100:00100000:0.0:1783951045.681926:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923858176 00000100:00100000:2.0:1783951045.683033:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 98 00000100:00100000:2.0:1783951045.683046:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:10864:x1870607923858176:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951045.683074:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951045.683096:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f86c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f67a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.683230:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.683244:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 24 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.683253:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.683292:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 24 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.683324:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 24 pid: 10105 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951045.683337:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944908160:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951045.683434:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb6900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951045.686136:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944908160:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951045.686232:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.687697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.687777:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923858304 00000100:00100000:0.0:1783951045.687788:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923858304 00010000:00010000:0.0:1783951045.687833:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 25 pid: 10105 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.687886:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:0.0:1783951045.687896:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:2407:x1870607923858304:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951045.687911:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951045.687917:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 25 pid: 10105 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.687929:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 25 pid: 10105 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.687950:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f86b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f673 expref: 25 pid: 10105 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.687999:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:0.0:1783951045.688004:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.688013:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.688020:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.688052:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951045.688123:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.688123:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:2407:x1870607923858304:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 227us (437us total) trans 0 rc 0/0 00010000:00010000:3.0:1783951045.688195:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.688201:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000004:00200000:3.0:1783951045.688237:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783951045.688453:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f86c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.688487:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.688498:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:3.0:1783951045.688502:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951045.688506:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608c00, rc 0) 00000100:00100000:3.0:1783951045.688577:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:10864:x1870607923858176:12345-192.168.202.33@tcp:101:bash.0 Request processed in 5532us (9091us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1783951045.688586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 98 00000100:00100000:3.0:1783951045.696500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.696627:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923858432 00000100:00100000:0.0:1783951045.696642:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923858432 00000100:00100000:0.0:1783951045.696717:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 99 00000100:00100000:0.0:1783951045.696742:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:10864:x1870607923858432:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951045.696767:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951045.696789:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f86de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f681 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.696827:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f86e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.696840:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f86e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.696937:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f86e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.697064:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f86de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f681 expref: 26 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.697084:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f86e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f681 expref: 25 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.697093:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:0.0:1783951045.697096:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951045.697099:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5da00, rc 0) 00000100:00100000:1.0:1783951045.698051:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:10864:x1870607923858432:12345-192.168.202.33@tcp:101:bash.0 Request processed in 1307us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951045.698060:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 99 00000100:00100000:0.0:1783951045.701805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.702100:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923858688 00000100:00100000:3.0:1783951045.702135:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923858688 00000100:00100000:1.0:1783951045.702297:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 100 00000100:00100000:1.0:1783951045.702317:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:10864:x1870607923858688:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:1.0:1783951045.702605:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.702622:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.702634:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951045.702681:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1783951045.702707:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acea1950 reply state 000000007116340e transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.702733:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.702741:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:1.0:1783951045.702744:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951045.702747:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783951045.702792:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1783951045.703026:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:10864:x1870607923858688:12345-192.168.202.33@tcp:36:bash.0 Request processed in 715us (1229us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1783951045.703034:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 100 00000020:00080000:1.0:1783951045.703040:0:11194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783951045.710525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.710748:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923858816 00000100:00100000:3.0:1783951045.710777:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923858816 00000100:00100000:3.0:1783951045.711209:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 101 00000100:00100000:3.0:1783951045.711225:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:10864:x1870607923858816:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951045.711260:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951045.711286:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f86f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f688 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.711367:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f86f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f688 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.711386:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f86f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f688 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.711412:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:3.0:1783951045.711416:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951045.711421:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8200, rc 0) 00000100:00100000:3.0:1783951045.711496:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:10864:x1870607923858816:12345-192.168.202.33@tcp:101:bash.0 Request processed in 275us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.711506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 101 00000100:00100000:3.0:1783951045.716469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951045.716769:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923858944 00000100:00100000:1.0:1783951045.716783:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923858944 00000100:00100000:1.0:1783951045.716979:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:1.0:1783951045.717003:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:10864:x1870607923858944:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951045.717022:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951045.717045:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f68f expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951045.717090:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a54eec4, atime: 0x6a54eec3, ctime: 0x6a54eec4, blocks: 0x8 00010000:00010000:1.0:1783951045.717113:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1783951045.717117:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951045.717126:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.717193:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951045.717207:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67000, rc 0) 00000100:00100000:1.0:1783951045.717272:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:10864:x1870607923858944:12345-192.168.202.33@tcp:101:bash.0 Request processed in 271us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951045.717280:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:0.0:1783951045.721060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951045.721283:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923859072 00000100:00100000:1.0:1783951045.721291:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923859072 00002000:00010000:1.0:1783951045.721327:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1783951045.721330:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e02479c5880 with x1870607923859072 ext(0->18446744073709551615) 00002000:00010000:1.0:1783951045.721340:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e02479c5880. 00000100:00100000:1.0:1783951045.721366:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:1.0:1783951045.721373:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923859072:12345-192.168.202.33@tcp:10:bash.0 00002000:00010000:1.0:1783951045.721875:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783951045.721879:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1783951044 -> 1783951045 00002000:00010000:1.0:1783951045.721883:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1783951043 -> 1783951043 00002000:00010000:1.0:1783951045.721886:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783951044 -> 1783951045 00002000:00010000:1.0:1783951045.721900:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1783951045.721968:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923859072:12345-192.168.202.33@tcp:10:bash.0 Request processed in 594us (915us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783951045.721977:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00002000:00010000:1.0:1783951045.721981:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1783951045.721993:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e02479c5880 with x1870607923859072 ext(0->18446744073709551615) 00002000:00010000:1.0:1783951045.721999:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e02479c5880. 00010000:00010000:3.0:1783951045.729029:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951045.729875:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951045.730216:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944908288:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730303:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944908800:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730320:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730332:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944909312:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730364:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730377:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944909824:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730390:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730405:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783951045.730414:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944908416:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730436:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730457:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944908928:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730476:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730491:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944909440:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730505:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730521:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944908544:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730545:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944909056:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730563:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944909568:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730574:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730582:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783951045.730585:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944908672:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730602:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944909184:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730613:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730622:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944909696:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730635:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.730662:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909312 00000100:00100000:0.0:1783951045.730668:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909312 00000100:00100000:0.0:1783951045.730708:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909824 00000100:00100000:0.0:1783951045.730711:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909824 00000100:00100000:0.0:1783951045.730723:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909184 00000100:00100000:0.0:1783951045.730725:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909184 00000100:00100000:0.0:1783951045.730736:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909696 00000100:00100000:0.0:1783951045.730745:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909696 00000100:00100000:0.0:1783951045.730762:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783951045.730767:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944909312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730806:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944909312:12345-0@lo:400:kworker.0 Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.730811:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783951045.730821:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951045.730824:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944909824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730840:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944909824:12345-0@lo:400:kworker.0 Request processed in 16us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.730843:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951045.730849:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783951045.730852:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944909184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730867:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944909184:12345-0@lo:400:kworker.0 Request processed in 15us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.730871:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783951045.730876:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783951045.730879:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944909696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.730893:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944909696:12345-0@lo:400:kworker.0 Request processed in 14us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.730897:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783951045.730908:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944908800 00000100:00100000:0.0:1783951045.730910:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944908800 00000100:00100000:0.0:1783951045.730932:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944908544 00000100:00100000:0.0:1783951045.730935:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944908544 00000100:00100000:0.0:1783951045.730947:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783951045.730952:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944908800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731004:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944908800:12345-0@lo:400:kworker.0 Request processed in 51us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731010:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783951045.731022:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783951045.731029:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944908544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731054:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944908544:12345-0@lo:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731058:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1783951045.731070:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951045.731073:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951045.731086:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944908416 00000100:00100000:0.0:1783951045.731088:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944908416 00000100:00100000:0.0:1783951045.731100:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944908928 00000100:00100000:0.0:1783951045.731101:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944908928 00000100:00100000:0.0:1783951045.731112:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909440 00000100:00100000:0.0:1783951045.731113:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909440 00000100:00100000:0.0:1783951045.731120:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909056 00000100:00100000:0.0:1783951045.731121:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909056 00000100:00100000:0.0:1783951045.731126:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909568 00000100:00100000:0.0:1783951045.731128:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909568 00000100:00100000:0.0:1783951045.731156:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944908672 00000100:00100000:0.0:1783951045.731158:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944908672 00000100:00100000:0.0:1783951045.731168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1783951045.731172:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944908416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731194:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944908416:12345-0@lo:400:kworker.0 Request processed in 22us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1783951045.731209:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783951045.731214:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944908928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731242:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944908928:12345-0@lo:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731246:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783951045.731254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1783951045.731259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944909440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731273:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944909440:12345-0@lo:400:kworker.0 Request processed in 15us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731278:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1783951045.731285:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783951045.731289:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944909056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731304:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944909056:12345-0@lo:400:kworker.0 Request processed in 15us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731311:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783951045.731330:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1783951045.731333:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951045.731339:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944909568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951045.731349:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944910080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951045.731374:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944909568:12345-0@lo:400:kworker.0 Request processed in 36us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731381:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1783951045.731392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.731398:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783951045.731406:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944908672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951045.731428:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944910080 00000100:00100000:3.0:1783951045.731433:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944910080 00000100:00100000:0.0:1783951045.731453:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944908672:12345-0@lo:400:kworker.0 Request processed in 47us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.731461:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783951045.731482:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1783951045.731483:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951045.731489:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951045.731492:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944910080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951045.731512:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1783951045.731531:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944908672:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731545:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944909184:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731558:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944909696:0@lo:400:kworker.0 00000100:00100000:3.0:1783951045.731561:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944910080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.731572:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783951045.731575:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944908544:0@lo:400:kworker.0 00010000:00080000:0.0:1783951045.731593:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02479c4000 x1870607944909056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951045.731605:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944909056:0@lo:400:kworker.0 00000100:00100000:3.0:1783951045.731608:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944910080:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783951045.731623:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02479c6680 x1870607944909568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951045.731633:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944909568:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731670:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944908416:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731680:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944908928:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731688:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944909440:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731696:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944908800:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731704:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944909312:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731711:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944909824:0@lo:400:kworker.0 00000100:00100000:0.0:1783951045.731723:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951045.731730:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944909952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951045.731752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951045.731821:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944909952 00000100:00100000:3.0:1783951045.731825:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944909952 00000100:00100000:3.0:1783951045.731851:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783951045.731856:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944909952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951045.731864:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1783951045.731886:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944909952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.731890:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783951045.731909:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944909952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951045.732254:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944910208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951045.732274:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944908288 00000100:00100000:3.0:1783951045.732277:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951045.732287:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944908288 00000100:00100000:0.0:1783951045.732320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783951045.732327:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944908288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951045.732390:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944910208 00000100:00100000:1.0:1783951045.732393:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944910208 00000100:00100000:0.0:1783951045.732439:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0346183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944908288:12345-0@lo:400:kworker.0 Request processed in 112us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951045.732447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1783951045.732450:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783951045.732458:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944910208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951045.732481:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1783951045.732513:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944908288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951045.732515:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944910208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951045.732534:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783951045.732575:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944910208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951045.811456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951045.811537:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923859200 00000100:00100000:2.0:1783951045.811545:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923859200 00000100:00100000:2.0:1783951045.811601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 102 00000100:00100000:2.0:1783951045.811608:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11351:x1870607923859200:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:2.0:1783951045.811699:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.811716:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812025:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812043:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812051:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812074:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812204:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812214:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812221:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951045.812275:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812288:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812294:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812301:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812307:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951045.812311:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812318:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812330:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951045.812352:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951045.812358:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812364:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8701 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812379:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812385:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812391:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812396:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951045.812399:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812404:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812412:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e0247828000) 00010000:00010000:2.0:1783951045.812415:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951045.812417:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812423:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8708 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812438:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812452:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812458:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812464:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951045.812467:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812474:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812482:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:2.0:1783951045.812485:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951045.812488:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.812493:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f870f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951045.812575:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11351:x1870607923859200:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 965us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951045.812585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 102 00000100:00100000:3.0:1783951045.852486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.852628:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923859456 00000100:00100000:0.0:1783951045.852642:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923859456 00000100:00100000:0.0:1783951045.852727:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 103 00000100:00100000:0.0:1783951045.852740:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11354:x1870607923859456:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951045.852771:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951045.852797:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8716 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f696 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.852905:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.852923:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.852935:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.852951:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.852958:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853002:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853213:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f872b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853223:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f872b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853231:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f872b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951045.853242:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783951045.853368:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853377:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853384:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853391:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951045.853396:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853405:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853418:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951045.853422:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951045.853440:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853447:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f871d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853463:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853470:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853476:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853482:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951045.853485:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853491:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853499:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:0.0:1783951045.853502:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951045.853504:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853510:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8724 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853557:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8716 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f696 expref: 33 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853585:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f872b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f696 expref: 32 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951045.853593:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:0.0:1783951045.853596:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783951045.853598:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c200, rc 0) 00000100:00100000:0.0:1783951045.853690:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11354:x1870607923859456:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 952us (1217us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1783951045.853700:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 103 00000100:00100000:0.0:1783951045.857520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951045.857622:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923859584 00000100:00100000:2.0:1783951045.857635:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923859584 00000100:00100000:2.0:1783951045.857707:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 104 00000100:00100000:2.0:1783951045.857717:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11354:x1870607923859584:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:2.0:1783951045.857804:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.857839:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.857849:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.857888:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.857900:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 32 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951045.857913:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944910336:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951045.858073:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb6900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951045.859927:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944910336:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951045.859959:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951045.860578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.860744:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923859840 00000100:00100000:3.0:1783951045.860769:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923859840 00000100:00100000:3.0:1783951045.861116:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:3.0:1783951045.861129:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:6178:x1870607923859840:12345-192.168.202.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783951045.861575:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:6178:x1870607923859840:12345-192.168.202.33@tcp:35:ldlm_bl.0 Request processed in 448us (1001us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1783951045.861586:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1783951045.864776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.864873:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923859968 00000100:00100000:3.0:1783951045.864886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923859968 00010000:00010000:3.0:1783951045.865546:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951045.865644:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:3.0:1783951045.865661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:2407:x1870607923859968:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951045.865683:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951045.865692:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.865706:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.865734:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f86d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f67a expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.865750:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:3.0:1783951045.865756:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.865792:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.865800:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951045.865848:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951045.865932:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:2407:x1870607923859968:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 276us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951045.865940:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00010000:00010000:2.0:1783951045.866516:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866526:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866588:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866596:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866603:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866623:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951045.866629:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866637:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866652:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:2.0:1783951045.866655:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951045.866659:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.866665:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8739 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951045.866747:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11354:x1870607923859584:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 9029us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951045.866758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 104 00000100:00100000:1.0:1783951045.870623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951045.870741:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923860224 00000100:00100000:0.0:1783951045.870753:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923860224 00000100:00100000:0.0:1783951045.870855:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783951045.870868:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:11354:x1870607923860224:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951045.871231:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:11354:x1870607923860224:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 364us (619us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783951045.871239:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783951045.980511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951045.980622:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923860480 00000100:00100000:2.0:1783951045.980633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923860480 00000100:00100000:2.0:1783951045.980701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 105 00000100:00100000:2.0:1783951045.980711:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:11365:x1870607923860480:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:2.0:1783951045.980748:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951045.980774:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8740 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f69d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.980883:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981074:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981087:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981105:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981112:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981119:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981301:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f8755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981309:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f8755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981315:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f8755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951045.981323:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783951045.981937:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981946:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981952:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981965:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951045.981970:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.981976:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982198:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951045.982202:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951045.982207:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982215:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8747 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982230:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982236:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982243:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982248:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951045.982251:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982257:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982275:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e0247828000) 00010000:00010000:2.0:1783951045.982277:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951045.982280:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982287:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f874e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982434:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8740 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f69d expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982451:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f8755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f69d expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951045.982459:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:2.0:1783951045.982461:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951045.982463:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608200, rc 0) 00000100:00100000:2.0:1783951045.982584:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11365:x1870607923860480:12345-192.168.202.33@tcp:101:cat.0 Request processed in 1873us (2085us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1783951045.982593:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 105 00000100:00100000:1.0:1783951045.990444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951045.990735:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923860736 00000100:00100000:3.0:1783951045.990748:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923860736 00000100:00100000:3.0:1783951045.991136:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:3.0:1783951045.991195:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11365:x1870607923860736:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:3.0:1783951045.991630:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:11365:x1870607923860736:12345-192.168.202.33@tcp:35:cat.0 Request processed in 439us (1200us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1783951045.991639:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:1.0:1783951046.019126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.019407:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923860992 00000100:00100000:0.0:1783951046.019422:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923860992 00000100:00100000:0.0:1783951046.019570:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 106 00000100:00080000:2.0:1783951046.019584:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951046.019584:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:11366:x1870607923860992:12345-192.168.202.33@tcp:36:rm.0 00010000:00010000:0.0:1783951046.019669:0:11194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1783951046.019725:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f86f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f688 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020070:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f8755 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f69d expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020084:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f872b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f696 expref: 34 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020097:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f86e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f681 expref: 33 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020110:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:0.0:1783951046.020116:0:11194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951046.020190:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020209:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020222:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020240:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020248:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020254:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020596:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020606:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.020614:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951046.021237:0:11194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1783951046.021251:0:11194:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401669107901ns, next at 402669104071ns, rc = 0 00010000:00010000:0.0:1783951046.021314:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021325:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021334:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021342:0:11194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021349:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021356:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021440:0:11194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951046.021468:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021484:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021490:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021496:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951046.021501:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021509:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021530:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:0.0:1783951046.021534:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783951046.021538:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021544:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8771 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021567:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021573:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021579:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021584:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951046.021594:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021600:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021609:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951046.021612:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951046.021615:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021620:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8763 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951046.021631:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fcf2fc5 reply state 0000000078ba7264 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021643:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.021650:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:0.0:1783951046.021652:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951046.021655:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951046.022053:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:11366:x1870607923860992:12345-192.168.202.33@tcp:36:rm.0 Request processed in 2466us (2935us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1783951046.022064:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 106 00010000:00010000:1.0:1783951046.023634:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951046.023647:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951046.023660:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951046.023665:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951046.023675:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951046.023715:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:1.0:1783951046.023718:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951046.023723:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951046.023741:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8778 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951046.023758:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951046.023760:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951046.023762:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951046.080504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.084484:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923861248 00000100:00100000:2.0:1783951046.084510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923861248 00000100:00100000:2.0:1783951046.084623:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 107 00000100:00100000:2.0:1783951046.084638:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:11372:x1870607923861248:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951046.084671:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.084700:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f877f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6a4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.084880:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.084900:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.084914:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.084928:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.084936:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.084944:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951046.085616:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783951046.085836:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085848:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085857:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085908:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085932:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085939:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085947:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.085954:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085962:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.085975:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951046.085978:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951046.085994:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.086000:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8786 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951046.086017:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075b8e472 reply state 0000000017fb0d97 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.086029:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.086035:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:2.0:1783951046.086522:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951046.086529:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783951046.086576:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f877f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.086604:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 36 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.086612:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:2.0:1783951046.086614:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951046.086616:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609e00, rc 0) 00000100:00100000:2.0:1783951046.086718:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:11372:x1870607923861248:12345-192.168.202.33@tcp:101:bash.0 Request processed in 2083us (6228us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783951046.086729:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 107 00000100:00100000:2.0:1783951046.091945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.092133:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923861376 00000100:00100000:0.0:1783951046.092182:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923861376 00000100:00100000:0.0:1783951046.092283:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:0.0:1783951046.092298:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923861376:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951046.092326:0:9851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951046.092379:0:9851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6ab expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951046.092417:0:9851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951046.092448:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1783951046.092454:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951046.092467:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 8 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.092492:0:9851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 8 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.092510:0:9851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d400, rc 0) 00000100:00100000:0.0:1783951046.092598:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2407:x1870607923861376:12345-192.168.202.33@tcp:101:bash.0 Request processed in 303us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.092607:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00080000:2.0:1783951046.093322:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951046.100278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.100422:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923861504 00000100:00100000:0.0:1783951046.100434:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923861504 00000100:00100000:0.0:1783951046.100504:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:0.0:1783951046.100516:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:11372:x1870607923861504:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951046.100541:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951046.100564:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6b2 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.100607:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 9 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.100645:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951046.100651:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951046.100658:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.100704:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 9 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.100721:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 9 pid: 9851 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951046.100739:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fca4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1870607944910464:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951046.100869:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951046.107105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.108383:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923861632 00000100:00100000:2.0:1783951046.108400:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923861632 00010000:00010000:2.0:1783951046.108467:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 10 pid: 9851 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.108518:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:2.0:1783951046.108529:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2407:x1870607923861632:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951046.108551:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951046.108581:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 10 pid: 9851 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.108599:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 10 pid: 9851 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.108655:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951046.108661:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951046.108671:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.108683:0:10402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.108731:0:10402:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.108748:0:10402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10402:1870607944910592:192.168.202.33@tcp:105: 00000100:00100000:2.0:1783951046.108862:0:10402:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb6e40 going to sleep for 11 seconds 00010000:00010000:0.0:1783951046.115022:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080645f29/0x7645c8e1169f87a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ab expref: 10 pid: 9851 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951046.116929:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fca4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1870607944910464:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951046.116988:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.117009:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d600, rc 0) 00000100:00100000:3.0:1783951046.118489:0:10402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10402:1870607944910592:192.168.202.33@tcp:105: 00010000:00010000:3.0:1783951046.118534:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951046.118613:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923861632:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 10085us (11521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951046.118628:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:0.0:1783951046.119525:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:11372:x1870607923861504:12345-192.168.202.33@tcp:101:bash.0 Request processed in 19003us (19255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.119556:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:1.0:1783951046.123687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.123798:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923861888 00000100:00100000:0.0:1783951046.123812:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923861888 00000100:00100000:0.0:1783951046.123899:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1783951046.123912:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:11372:x1870607923861888:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:0.0:1783951046.124400:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11372:x1870607923861888:12345-192.168.202.33@tcp:35:bash.0 Request processed in 489us (727us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1783951046.124410:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1783951046.319606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.319750:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923862016 00000100:00100000:2.0:1783951046.319762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923862016 00000100:00100000:2.0:1783951046.319909:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 108 00000100:00100000:2.0:1783951046.319922:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:11388:x1870607923862016:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951046.319955:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.319996:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f87b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6b9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.320087:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f87b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.320106:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f87b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.320138:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f87b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951046.320274:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783951046.320279:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951046.320305:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f87b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.320335:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f87b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b9 expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.320360:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f87b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b9 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.320370:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951046.320374:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951046.320378:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608a00, rc 0) 00000100:00100000:2.0:1783951046.320454:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:11388:x1870607923862016:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 535us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.320462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 108 00000100:00100000:1.0:1783951046.325089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.325428:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923862272 00000100:00100000:0.0:1783951046.325443:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923862272 00000100:00100000:0.0:1783951046.325559:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 109 00000100:00100000:0.0:1783951046.325573:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:11388:x1870607923862272:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951046.325604:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951046.325634:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f87be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6c0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.325792:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f87c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.325808:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f87c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.325835:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f87c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951046.325851:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783951046.326121:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f87be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c0 expref: 42 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.326214:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f87c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c0 expref: 41 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.326224:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:0.0:1783951046.326228:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951046.326232:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c200, rc 0) 00000100:00100000:0.0:1783951046.326492:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+41:11388:x1870607923862272:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 921us (1416us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1783951046.326502:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 109 00000100:00100000:3.0:1783951046.329550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.329650:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923862528 00000100:00100000:2.0:1783951046.329664:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923862528 00000100:00100000:2.0:1783951046.329743:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 110 00000100:00100000:2.0:1783951046.329755:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+41:11388:x1870607923862528:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951046.329790:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.329818:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6c7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.330017:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.330036:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.330050:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951046.330064:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783951046.330273:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c7 expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.330296:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c7 expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.330305:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:2.0:1783951046.330309:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783951046.330313:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609a00, rc 0) 00000100:00100000:2.0:1783951046.330387:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:11388:x1870607923862528:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 635us (851us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1783951046.330396:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 110 00000100:00100000:3.0:1783951046.332719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.332852:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923862656 00000100:00100000:2.0:1783951046.332865:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923862656 00000100:00100000:2.0:1783951046.332940:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951046.332954:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:2408:x1870607923862656:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951046.332974:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951046.334349:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f87c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c0 expref: 43 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.334376:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:2.0:1783951046.334382:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951046.334480:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:2408:x1870607923862656:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 1529us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.334492:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:1.0:1783951046.344714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.344853:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923862784 00000100:00100000:0.0:1783951046.344866:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923862784 00000100:00100000:0.0:1783951046.344939:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:0.0:1783951046.344953:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923862784:12345-192.168.202.33@tcp:1:lfs.0 00010000:00010000:0.0:1783951046.345028:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.345056:0:9851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.345066:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951046.345072:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951046.345078:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.345126:0:9851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.345195:0:9851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 8 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951046.345214:0:9851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fca4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9851:1870607944910720:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951046.345600:0:9851:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951046.347946:0:9851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fca4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9851:1870607944910720:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951046.348000:0:9851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951046.349354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.349472:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923862912 00000100:00100000:2.0:1783951046.349482:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923862912 00002000:00100000:2.0:1783951046.349549:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9e037fdd9180 x1870607923862912/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:62/0 lens 504/0 e 0 to 0 dl 1783951057 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951046.349561:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e037fdd9180 with x1870607923862912 ext(0->8) 00010000:00010000:2.0:1783951046.349570:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 9 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.349589:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 9 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951046.349597:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e037fdd9180 00000100:00100000:2.0:1783951046.349639:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:2.0:1783951046.349650:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923862912:12345-192.168.202.33@tcp:4:lfs.0 00000100:00100000:2.0:1783951046.350987:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2408:x1870607923862912:12345-192.168.202.33@tcp:4:lfs.0 Request processed in 1315us (1622us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783951046.351000:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00002000:00100000:2.0:1783951046.351012:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9e037fdd9180 x1870607923862912/t4294967303(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:62/0 lens 504/448 e 0 to 0 dl 1783951057 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951046.351032:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e037fdd9180 with x1870607923862912 ext(0->8) 00010000:00010000:2.0:1783951046.351042:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 11 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.351060:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 11 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951046.351068:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e037fdd9180 00000100:00100000:0.0:1783951046.358254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951046.358618:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923863040 00000100:00100000:3.0:1783951046.358632:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923863040 00010000:00010000:3.0:1783951046.358693:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 11 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951046.358758:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:3.0:1783951046.358770:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0378f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2407:x1870607923863040:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951046.358792:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783951046.358819:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783951046.358822:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783951046 00002000:00010000:3.0:1783951046.358825:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783951046 00002000:00010000:3.0:1783951046.358827:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783951046 00002000:00010000:3.0:1783951046.358830:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783951046.358837:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 11 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.358853:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 11 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.358884:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f87a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b2 expref: 11 pid: 8440 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.358907:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1783951046.358911:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951046.358918:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.358947:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.359070:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951046.359311:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0378f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2407:x1870607923863040:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 541us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951046.359321:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00010000:00010000:0.0:1783951046.359507:0:9851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359519:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359553:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359562:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359570:0:9851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359578:0:9851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951046.359582:0:9851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359608:0:9851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359623:0:9851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.359631:0:9851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f87e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951046.359694:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923862784:12345-192.168.202.33@tcp:1:lfs.0 Request processed in 14744us (14996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.359704:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:0.0:1783951046.364731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.364846:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923863296 00000100:00100000:2.0:1783951046.364860:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923863296 00000100:00100000:2.0:1783951046.364933:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:2.0:1783951046.364946:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03494c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:11388:x1870607923863296:12345-192.168.202.33@tcp:35:lfs.0 00000004:00010000:2.0:1783951046.365050:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c7 expref: 42 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951046.365366:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1783951046.365408:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1783951046.366139:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1783951046.366665:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.366689:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.366700:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.366763:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.366782:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 46 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.366799:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1870607944910848:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951046.367014:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb6600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951046.371832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951046.371928:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923863424 00000100:00100000:3.0:1783951046.371940:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923863424 00010000:00010000:3.0:1783951046.372005:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 47 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951046.372056:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:3.0:1783951046.372069:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:2407:x1870607923863424:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951046.372088:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951046.372096:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 47 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.372112:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 47 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.372185:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:3.0:1783951046.372192:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.372203:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.372232:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.372273:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951046.372335:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:2407:x1870607923863424:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 269us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951046.372344:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00010000:00010000:2.0:1783951046.374367:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8794 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6a4 expref: 46 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.374400:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1870607944910848:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951046.374435:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.374448:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.374454:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951046.374661:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1783951046.374809:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1783951046.375080:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944910976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783951046.375300:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951046.375345:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951046.375489:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944910976 00000100:00100000:3.0:1783951046.375498:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944910976 00000100:00100000:3.0:1783951046.375572:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783951046.375585:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6528:x1870607944910976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783951046.375702:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6528:x1870607944910976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951046.375710:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783951046.375854:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944910976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783951046.376039:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1783951046.376106:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944911104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783951046.376184:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951046.376205:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951046.376401:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944911104 00000100:00100000:0.0:1783951046.376408:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944911104 00000100:00100000:0.0:1783951046.376454:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951046.376463:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6528:x1870607944911104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783951046.376612:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6528:x1870607944911104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (468us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783951046.376620:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783951046.377517:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1870607944911104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783951046.377607:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1783951046.377671:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.377682:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.377690:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.377696:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.377701:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.377709:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.377726:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:2.0:1783951046.377729:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783951046.377734:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.377741:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f87ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951046.377955:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783951046.378132:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1783951046.378187:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402026043933ns, next at 403026041060ns, rc = 0 00000001:00080000:2.0:1783951046.378197:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1783951046.378228:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828000) 00010000:00010000:2.0:1783951046.378231:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783951046.378240:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6c7 expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.378373:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03494c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:11388:x1870607923863296:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 13430us (13656us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1783951046.378385:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000020:00080000:2.0:1783951046.378391:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783951046.382043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.382215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923863552 00000100:00100000:2.0:1783951046.382229:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923863552 00000100:00100000:2.0:1783951046.382303:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 111 00000100:00100000:2.0:1783951046.382316:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:11388:x1870607923863552:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951046.382352:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.382384:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f87f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6ce expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.382471:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f87f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ce expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.382490:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f87f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ce expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.382516:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.382520:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951046.382542:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608000, rc 0) 00000100:00100000:2.0:1783951046.382612:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+50:11388:x1870607923863552:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 299us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.382621:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 111 00000100:00100000:0.0:1783951046.386639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951046.387476:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923863808 00000100:00100000:3.0:1783951046.387492:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923863808 00000100:00100000:3.0:1783951046.387627:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:3.0:1783951046.387641:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+50:11388:x1870607923863808:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1783951046.388443:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+51:11388:x1870607923863808:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 800us (1813us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1783951046.388455:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:0.0:1783951046.478838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.479064:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923863936 00000100:00100000:2.0:1783951046.479078:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923863936 00000100:00100000:2.0:1783951046.479239:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 112 00000100:00100000:2.0:1783951046.479253:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+51:11398:x1870607923863936:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:2.0:1783951046.479382:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479405:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479420:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479433:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479441:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479447:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479558:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479568:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479600:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951046.479669:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479686:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479693:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479702:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479709:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.479714:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479723:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479738:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951046.479742:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951046.479748:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479755:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f87fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479771:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479788:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479794:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479800:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.479803:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479810:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479819:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:2.0:1783951046.479821:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951046.479824:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479830:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8804 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479842:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479848:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479854:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479859:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.479869:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479875:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.479884:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.479887:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951046.479890:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.480051:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f880b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.480492:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+51:11398:x1870607923863936:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 1238us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.480503:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 112 00000100:00100000:1.0:1783951046.509738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.510203:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923864192 00000100:00100000:0.0:1783951046.510218:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923864192 00000100:00100000:0.0:1783951046.510527:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:0.0:1783951046.510558:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+51:11401:x1870607923864192:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951046.510589:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951046.510616:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8812 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6d5 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.510714:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.510733:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.510748:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.510759:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.510767:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.510773:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.511069:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.511079:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.511087:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951046.511112:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783951046.511248:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.511962:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.511974:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.511990:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951046.511995:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512004:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512021:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951046.512024:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951046.512030:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512038:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8819 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512060:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512066:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512092:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512097:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951046.512100:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512106:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512115:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:0.0:1783951046.512118:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951046.512121:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512127:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8820 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512311:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f8812 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 54 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512328:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 53 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.512337:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951046.512339:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951046.512342:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d600, rc 0) 00000100:00100000:0.0:1783951046.512448:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:11401:x1870607923864192:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1891us (2723us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783951046.512466:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:3.0:1783951046.515303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.515464:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923864320 00000100:00100000:2.0:1783951046.515477:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923864320 00000100:00100000:2.0:1783951046.515553:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:2.0:1783951046.515565:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:11401:x1870607923864320:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:2.0:1783951046.515664:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515685:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515699:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515750:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515777:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515785:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515791:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.515797:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515806:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515821:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.515825:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951046.515841:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.515848:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8835 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.515959:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:11401:x1870607923864320:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 396us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.515968:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:3.0:1783951046.518410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.518760:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923864576 00000100:00100000:2.0:1783951046.518774:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923864576 00000100:00100000:2.0:1783951046.518856:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:2.0:1783951046.518869:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:11401:x1870607923864576:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951046.519414:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11401:x1870607923864576:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 542us (1013us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1783951046.519443:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:2.0:1783951046.591494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951046.591610:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923864832 00000100:00100000:3.0:1783951046.591624:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923864832 00000100:00100000:3.0:1783951046.591712:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 115 00000100:00100000:3.0:1783951046.591746:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11411:x1870607923864832:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951046.591781:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951046.591787:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783951046.591841:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f87b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6b9 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.591868:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951046.591873:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951046.591891:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f883c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6dc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.592065:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.592083:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 54 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.592094:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.592221:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 54 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.592239:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 54 pid: 11194 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951046.592505:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944911232:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951046.592630:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951046.596478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.596582:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923864960 00000100:00100000:2.0:1783951046.596592:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923864960 00010000:00010000:2.0:1783951046.596647:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 55 pid: 11194 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.596703:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:2.0:1783951046.596715:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:2407:x1870607923864960:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951046.596765:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951046.596773:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 55 pid: 11194 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.596789:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 55 pid: 11194 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.596817:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.596834:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.596845:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.596854:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.596876:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951046.596952:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:2407:x1870607923864960:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 238us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.596967:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00010000:00010000:3.0:1783951046.598013:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8827 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6d5 expref: 54 pid: 11194 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951046.598041:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944911232:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951046.598076:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.598088:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.598095:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951046.598124:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783951046.598568:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f883c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.598590:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 54 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.598600:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:3.0:1783951046.598604:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951046.598607:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9e00, rc 0) 00000100:00100000:3.0:1783951046.598678:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11411:x1870607923864832:12345-192.168.202.33@tcp:101:bash.0 Request processed in 6936us (7202us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783951046.598688:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 115 00000100:00100000:0.0:1783951046.602300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.602503:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923865088 00000100:00100000:2.0:1783951046.602516:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923865088 00000100:00100000:2.0:1783951046.602589:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 116 00000100:00100000:2.0:1783951046.602601:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:11411:x1870607923865088:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951046.602636:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.602665:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8851 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6e3 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.602710:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.602728:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.602742:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.602922:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 56 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.602946:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 55 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.602956:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.602959:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783951046.602963:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609a00, rc 0) 00000100:00100000:2.0:1783951046.603043:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:11411:x1870607923865088:12345-192.168.202.33@tcp:101:bash.0 Request processed in 443us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.603058:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 116 00000100:00100000:1.0:1783951046.606699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.607004:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923865344 00000100:00100000:0.0:1783951046.607018:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923865344 00000100:00100000:0.0:1783951046.607098:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:0.0:1783951046.607111:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:11411:x1870607923865344:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:0.0:1783951046.607496:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.607521:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.607534:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951046.607593:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1783951046.607619:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2255918 reply state 0000000099b97266 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.607633:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.607641:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951046.607644:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951046.607648:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951046.607762:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11411:x1870607923865344:12345-192.168.202.33@tcp:36:bash.0 Request processed in 653us (1077us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1783951046.607771:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 117 00000020:00080000:0.0:1783951046.607792:0:11194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783951046.611048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951046.611162:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923865472 00000100:00100000:3.0:1783951046.611176:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923865472 00000100:00100000:3.0:1783951046.611252:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:3.0:1783951046.611280:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11411:x1870607923865472:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951046.611312:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951046.611336:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8866 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6ea expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.611467:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.611483:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.611493:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.611535:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.611549:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 59 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951046.611566:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944911360:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951046.611681:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951046.614311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.614409:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923865600 00000100:00100000:0.0:1783951046.614422:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923865600 00010000:00010000:0.0:1783951046.614474:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 60 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951046.614523:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:0.0:1783951046.614534:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:2408:x1870607923865600:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951046.614555:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951046.614564:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 60 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.614581:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 60 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.614610:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951046.614616:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.614628:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.614638:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.614661:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951046.614734:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:2408:x1870607923865600:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 201us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.614741:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 71 00010000:00010000:2.0:1783951046.615213:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f8843 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6dc expref: 59 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.615234:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944911360:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951046.615279:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.615290:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.615296:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951046.615373:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783951046.615379:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951046.615405:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.615441:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f8866 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.615471:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.615479:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.615482:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951046.615485:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144000, rc 0) 00000100:00100000:2.0:1783951046.615550:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11411:x1870607923865472:12345-192.168.202.33@tcp:101:bash.0 Request processed in 4273us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.615558:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:3.0:1783951046.620184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.620325:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923865856 00000100:00100000:2.0:1783951046.620340:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923865856 00000100:00100000:2.0:1783951046.620417:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:2.0:1783951046.620430:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:11411:x1870607923865856:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:2.0:1783951046.620742:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11411:x1870607923865856:12345-192.168.202.33@tcp:35:bash.0 Request processed in 314us (614us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1783951046.620751:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:0.0:1783951046.681505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951046.681641:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923865984 00000100:00100000:3.0:1783951046.681654:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923865984 00000100:00100000:3.0:1783951046.681735:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:3.0:1783951046.681747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:11417:x1870607923865984:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951046.681802:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951046.681841:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6f1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.681933:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f887b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.681951:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f887b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.681966:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f887b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951046.682046:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783951046.682052:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951046.682075:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f887b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.682105:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6f1 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.682129:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f887b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6f1 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.682139:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:3.0:1783951046.682203:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951046.682208:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145a00, rc 0) 00000100:00100000:3.0:1783951046.682306:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11417:x1870607923865984:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 560us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951046.682314:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:0.0:1783951046.686275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.686481:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923866112 00000100:00100000:2.0:1783951046.686494:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923866112 00000100:00100000:2.0:1783951046.686576:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:2.0:1783951046.686588:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11417:x1870607923866112:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951046.686616:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.686643:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8882 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6f8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686726:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686744:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686759:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686771:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686800:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686808:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686917:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686927:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.686935:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951046.687006:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783951046.687011:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951046.687035:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687049:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687059:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687066:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687073:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687091:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.687096:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687106:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687120:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951046.687123:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951046.687128:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687135:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8889 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687179:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687187:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687193:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687199:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951046.687203:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687210:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687228:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:2.0:1783951046.687231:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951046.687235:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687241:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8890 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687546:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8882 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6f8 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687564:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6f8 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.687572:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.687574:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951046.687576:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608400, rc 0) 00000100:00100000:2.0:1783951046.687660:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11417:x1870607923866112:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1074us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.687670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:2.0:1783951046.692426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.692480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.692625:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923866496 00000100:00100000:0.0:1783951046.692638:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923866496 00000100:00100000:0.0:1783951046.692716:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:0.0:1783951046.692727:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:2407:x1870607923866496:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951046.692749:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951046.692779:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8897 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6f8 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.692803:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951046.692810:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951046.692946:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923866368 00000100:00100000:3.0:1783951046.692951:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923866368 00000100:00100000:3.0:1783951046.693002:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:3.0:1783951046.693011:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11417:x1870607923866368:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951046.693033:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951046.693053:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f889e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f6ff expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.693216:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.693233:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.693242:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.693298:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.693314:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951046.693330:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944911488:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951046.693426:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:2407:x1870607923866496:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 700us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.693435:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:3.0:1783951046.693764:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951046.698511:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944911488:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951046.698560:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951046.699363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.699536:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923866624 00000100:00100000:0.0:1783951046.699547:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923866624 00010000:00010000:0.0:1783951046.699598:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951046.699695:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:0.0:1783951046.699707:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:2407:x1870607923866624:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951046.699726:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951046.699734:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.699748:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.699788:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f886d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ea expref: 62 pid: 6527 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.699810:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951046.699815:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.699838:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.699847:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.699877:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951046.699950:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:2407:x1870607923866624:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 244us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.699958:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 72 00010000:00010000:3.0:1783951046.700067:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.700076:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951046.700102:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783951046.700310:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f889e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.700327:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951046.700334:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:3.0:1783951046.700337:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951046.700340:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:3.0:1783951046.700369:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11417:x1870607923866368:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 7360us (7960us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1783951046.700376:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:0.0:1783951046.717385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.717518:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923866880 00000100:00100000:2.0:1783951046.717531:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923866880 00000100:00100000:2.0:1783951046.717664:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:2.0:1783951046.717677:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11417:x1870607923866880:12345-192.168.202.33@tcp:103:lfs.0 00010000:00010000:2.0:1783951046.717721:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951046.717752:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f87f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ce expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.717775:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.717781:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951046.717864:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11417:x1870607923866880:12345-192.168.202.33@tcp:103:lfs.0 Request processed in 189us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.717873:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:2.0:1783951046.720001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951046.720096:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923867008 00000100:00100000:0.0:1783951046.720107:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923867008 00000100:00100000:0.0:1783951046.720205:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:0.0:1783951046.720217:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11417:x1870607923867008:12345-192.168.202.33@tcp:58:lfs.0 00010000:00010000:0.0:1783951046.720378:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.720401:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951046.720416:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951046.720580:0:11194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783951046.720703:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11417:x1870607923867008:12345-192.168.202.33@tcp:58:lfs.0 Request processed in 486us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951046.720714:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:3.0:1783951046.723415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951046.723582:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923867136 00000100:00100000:2.0:1783951046.723595:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923867136 00000100:00100000:2.0:1783951046.723674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:2.0:1783951046.723686:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:11417:x1870607923867136:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951046.723717:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951046.723746:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f706 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.723834:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.723847:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.723873:0:6526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.723889:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.723923:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951046.723927:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951046.723931:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951046.723939:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608000, rc 0) 00000100:00100000:2.0:1783951046.724030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11417:x1870607923867136:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 346us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951046.724038:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 123 00010000:00010000:1.0:1783951046.753246:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951047.136435:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951047.136447:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951047.136625:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1783951047.136638:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951047.136840:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b89f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944911616:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783951047.137199:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951047.145074:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b89f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944911616:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783951047.145452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.146322:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923867264 00000100:00100000:2.0:1783951047.146334:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923867264 00000100:00100000:2.0:1783951047.146474:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:2.0:1783951047.146500:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11418:x1870607923867264:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951047.146549:0:6527:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951047.146728:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11418:x1870607923867264:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 242us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951047.146737:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:2.0:1783951047.159293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.159464:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923867392 00000100:00100000:1.0:1783951047.159478:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923867392 00000100:00100000:1.0:1783951047.159573:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:1.0:1783951047.159606:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11418:x1870607923867392:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783951047.159711:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159733:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159747:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159765:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159772:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159779:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159808:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159832:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159840:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951047.159920:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783951047.159926:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951047.159943:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159968:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159987:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.159995:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160001:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951047.160007:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160015:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160030:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951047.160034:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951047.160039:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160046:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f88c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160064:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160070:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160076:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160088:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951047.160092:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160098:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160107:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9e0246937100) 00010000:00010000:1.0:1783951047.160109:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951047.160112:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160118:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f88c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160135:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160184:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160190:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160195:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951047.160197:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160203:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160221:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951047.160223:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951047.160226:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.160232:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f88cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.160337:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11418:x1870607923867392:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 733us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.160347:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:2.0:1783951047.164314:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.164477:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923867648 00000100:00100000:0.0:1783951047.164826:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923867648 00000100:00100000:0.0:1783951047.165031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:0.0:1783951047.165044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:11418:x1870607923867648:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951047.165075:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951047.165101:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f88d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f70d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165457:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165478:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165508:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951047.165522:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783951047.165639:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165649:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165656:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165672:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.165677:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165686:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165701:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951047.165705:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951047.165711:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165718:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f88dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165768:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f88d6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f70d expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165780:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951047.165783:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951047.165787:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f88d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f70d expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.165798:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c200, rc 0) 00000100:00100000:0.0:1783951047.166083:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:11418:x1870607923867648:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1040us (1781us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1783951047.166092:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:0.0:1783951047.174525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.174692:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923867776 00000100:00100000:2.0:1783951047.174705:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923867776 00000100:00100000:2.0:1783951047.174787:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:2.0:1783951047.174799:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:11418:x1870607923867776:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951047.174848:0:6527:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951047.175023:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:11418:x1870607923867776:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 227us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951047.175038:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:3.0:1783951047.179013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.185765:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923868032 00000100:00100000:2.0:1783951047.185788:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923868032 00000100:00100000:2.0:1783951047.186286:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:2.0:1783951047.186304:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:11418:x1870607923868032:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951047.186333:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951047.186337:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783951047.186982:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f887b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6f1 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.187012:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:2.0:1783951047.187018:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951047.187040:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f88eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f714 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951047.189378:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1783951047.189872:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f88f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.192378:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f88f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.192401:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f88f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.192571:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f88eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f714 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.192628:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f88f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f714 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.192637:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828000) 00010000:00010000:2.0:1783951047.192640:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951047.192644:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609600, rc 0) 00000100:00100000:2.0:1783951047.193715:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:11418:x1870607923868032:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 7405us (14707us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1783951047.193727:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:2.0:1783951047.199286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.199633:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923868288 00000100:00100000:0.0:1783951047.199646:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923868288 00000100:00100000:0.0:1783951047.199723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:0.0:1783951047.199736:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:11418:x1870607923868288:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951047.199813:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951047.199846:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f88f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f714 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.199870:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828000) 00010000:00010000:0.0:1783951047.199893:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951047.199919:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.199937:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.199950:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.199967:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.199985:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.199993:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200060:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200093:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200100:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200107:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.200112:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200121:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200130:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951047.200133:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.200137:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200304:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8900 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200317:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200323:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200329:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200335:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.200356:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200363:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200371:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xbebcb3de (ffff9e024782e700) 00010000:00010000:0.0:1783951047.200373:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.200376:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.200383:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8907 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbebcb3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951047.200561:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:11418:x1870607923868288:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 826us (1289us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951047.200571:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:1.0:1783951047.206796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.208746:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923868416 00000100:00100000:2.0:1783951047.208771:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923868416 00000100:00100000:2.0:1783951047.208860:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:2.0:1783951047.208872:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:11418:x1870607923868416:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951047.208912:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951047.208945:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f890e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f71b expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.209003:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.209019:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.209033:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.209222:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f890e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 64 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.209244:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 63 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.209254:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:2.0:1783951047.209257:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783951047.209262:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608600, rc 0) 00000100:00100000:2.0:1783951047.209362:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:11418:x1870607923868416:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 491us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951047.209371:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:3.0:1783951047.212790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.212892:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923868672 00000100:00100000:0.0:1783951047.212905:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923868672 00000100:00100000:0.0:1783951047.213007:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 131 00000100:00100000:0.0:1783951047.213021:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:11418:x1870607923868672:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951047.213173:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.213197:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.213215:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951047.213519:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1783951047.213532:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402861389345ns, next at 403861386028ns, rc = 0 00000004:00010000:1.0:1783951047.213602:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e11742b reply state 00000000390fd1f4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.213618:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.213628:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:1.0:1783951047.213631:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783951047.213636:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951047.216771:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:11418:x1870607923868672:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 3735us (3977us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1783951047.216788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 131 00000100:00100000:2.0:1783951047.224737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.224984:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923868800 00000100:00100000:0.0:1783951047.225015:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923868800 00000100:00100000:0.0:1783951047.225137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:0.0:1783951047.225198:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:11418:x1870607923868800:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951047.225288:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951047.225321:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f722 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.225423:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.225447:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.225471:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:1.0:1783951047.225475:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951047.225479:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67600, rc 0) 00000100:00100000:1.0:1783951047.225563:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:11418:x1870607923868800:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 370us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.225572:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:3.0:1783951047.229232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.229577:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923868928 00000100:00100000:2.0:1783951047.229591:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923868928 00000100:00100000:2.0:1783951047.229712:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:2.0:1783951047.229724:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923868928:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783951047.229997:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923868928:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 275us (777us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783951047.230006:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00080000:0.0:1783951047.230227:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951047.233726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.233819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923869184 00000100:00100000:2.0:1783951047.233829:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923869184 00000100:00100000:2.0:1783951047.233899:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951047.233908:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:11418:x1870607923869184:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783951047.234261:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:11418:x1870607923869184:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 354us (546us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1783951047.234284:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951047.239634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.239782:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923869440 00000100:00100000:1.0:1783951047.239794:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923869440 00000100:00100000:1.0:1783951047.240056:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:1.0:1783951047.240071:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:11418:x1870607923869440:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951047.240256:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:11418:x1870607923869440:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 189us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.240265:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:0.0:1783951047.243512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.243657:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923869568 00000100:00100000:1.0:1783951047.243670:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923869568 00000100:00100000:1.0:1783951047.243803:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:1.0:1783951047.243816:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:11418:x1870607923869568:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951047.243845:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951047.243871:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f892a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f729 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.244029:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8931 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.244046:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.244061:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951047.244126:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951047.244197:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.244231:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f892a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f729 expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.244255:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f729 expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.244266:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:1.0:1783951047.244269:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783951047.244273:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951047.244357:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:11418:x1870607923869568:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 543us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.244365:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:0.0:1783951047.246749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.246911:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923869696 00000100:00100000:3.0:1783951047.246924:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923869696 00000100:00100000:3.0:1783951047.247050:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:3.0:1783951047.247064:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923869696:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951047.247088:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951047.247114:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f730 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951047.247182:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54eec7, blocks: 0x0 00010000:00010000:1.0:1783951047.247342:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1783951047.247350:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951047.247364:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 10 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.247404:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 10 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.247419:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145e00, rc 0) 00000100:00100000:1.0:1783951047.247487:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2407:x1870607923869696:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 427us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.247495:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:3.0:1783951047.250192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.250302:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923869952 00000100:00100000:0.0:1783951047.250317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923869952 00000100:00100000:0.0:1783951047.250444:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:0.0:1783951047.250458:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:11418:x1870607923869952:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783951047.250608:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:11418:x1870607923869952:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 153us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951047.250617:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:3.0:1783951047.253267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.253384:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870080 00000100:00100000:1.0:1783951047.253395:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870080 00000100:00100000:1.0:1783951047.253468:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:1.0:1783951047.253479:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:11418:x1870607923870080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951047.253501:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951047.253525:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f737 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.253565:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.253576:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951047.253582:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951047.253588:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.253629:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.253661:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.253677:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944911744:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951047.253783:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951047.256298:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944911744:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951047.256349:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.256376:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031c00, rc 0) 00000100:00100000:3.0:1783951047.256452:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:11418:x1870607923870080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 2974us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.256463:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:3.0:1783951047.258631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.258758:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870208 00000100:00100000:1.0:1783951047.258769:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870208 00010000:00010000:1.0:1783951047.258838:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.258893:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:1.0:1783951047.258905:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343006050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2407:x1870607923870208:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951047.258925:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951047.258954:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.258984:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.259013:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8938 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f730 expref: 11 pid: 8441 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.259035:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951047.259125:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951047.259135:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.259196:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.259247:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.259263:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fddbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1870607944911872:192.168.202.33@tcp:105: 00000100:00100000:1.0:1783951047.259359:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951047.264202:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fddbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1870607944911872:192.168.202.33@tcp:105: 00010000:00010000:3.0:1783951047.264245:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951047.264321:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343006050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2407:x1870607923870208:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 5417us (5703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.264352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:1.0:1783951047.268180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.268294:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870336 00000100:00100000:2.0:1783951047.268307:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870336 00002000:00100000:2.0:1783951047.268376:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9e037fddb480 x1870607923870336/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:63/0 lens 504/0 e 0 to 0 dl 1783951058 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951047.268389:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e037fddb480 with x1870607923870336 ext(0->12) 00002000:00010000:2.0:1783951047.268396:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e037fddb480 00000100:00100000:2.0:1783951047.268439:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:2.0:1783951047.268451:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2407:x1870607923870336:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783951047.272560:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:2407:x1870607923870336:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 Request processed in 4093us (4410us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783951047.272580:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00002000:00100000:2.0:1783951047.272600:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9e037fddb480 x1870607923870336/t4294967309(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:63/0 lens 504/448 e 0 to 0 dl 1783951058 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783951047.272611:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e037fddb480 with x1870607923870336 ext(0->12) 00002000:00010000:2.0:1783951047.272619:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e037fddb480 00000100:00100000:1.0:1783951047.275440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.275737:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870464 00000100:00100000:0.0:1783951047.275751:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870464 00000100:00100000:0.0:1783951047.275943:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:0.0:1783951047.275956:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:11418:x1870607923870464:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783951047.279418:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1783951047.279446:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783951047.279502:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783951047.279527:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e0377bb6e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783951047.279532:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0246a54900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e0377bb69c0 00000020:00080000:1.0:1783951047.279535:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0246a54a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e037e98f400 00000004:00080000:1.0:1783951047.279561:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783951047.279593:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e03507b36c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783951047.279596:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e03485e9400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e03507b3240 00000020:00080000:1.0:1783951047.279599:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e03485e9000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e02481b0600 00000020:00080000:1.0:1783951047.279611:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1783951047.279824:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1783951047.279908:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1783951047.279987:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944912000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783951047.280085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951047.280229:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944912000 00000100:00100000:3.0:1783951047.280239:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944912000 00000100:00100000:3.0:1783951047.280321:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783951047.280334:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1870607944912000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783951047.280368:0:9851:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1783951047.280412:0:9851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a54eec6, atime: 0x6a54eec6, ctime: 0x6a54eec6, blocks: 0x8 00010000:00010000:3.0:1783951047.280421:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280442:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1783951047.280447:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951047.280456:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280474:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280485:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280495:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280532:0:9851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951047.280714:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3654:x1870607944912000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 381us (627us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783951047.280723:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1783951047.280751:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951047.280759:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280768:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951047.280773:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280782:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280801:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280809:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e195d8d0/0x7645c8e1169f8946 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.280832:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951047.280835:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951047.280836:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783951047.280872:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0247b64380/2, rc 0, transno 4294967305 00000100:00100000:3.0:1783951047.280878:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944912000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951047.281048:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944912256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783951047.281082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951047.281185:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951047.281193:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944912128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783951047.281217:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951047.281243:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944912256 00000100:00100000:3.0:1783951047.281248:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944912256 00000100:00100000:3.0:1783951047.281277:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944912128 00000100:00100000:3.0:1783951047.281279:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944912128 00000100:00100000:3.0:1783951047.281294:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951047.281300:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944912256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783951047.281404:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783951047.281408:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783951047 00002000:00010000:3.0:1783951047.281410:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783951047.281412:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1783951047 -> 1783951047 00002000:00010000:3.0:1783951047.281415:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783951047.281443:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1870607944912256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (361us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783951047.281449:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951047.281462:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783951047.281468:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944912128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783951047.281479:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1783951047.281493:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.281512:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.281520:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783951047.281530:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951047.281535:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.281564:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.281580:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 11 pid: 8440 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.281593:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1870607944912384:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951047.281655:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1e40 going to sleep for 11 seconds 00000004:00080000:3.0:1783951047.281680:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e024818b800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783951047.281685:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944912256:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1783951047.281752:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951047.281756:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951047.284505:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1870607944912384:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951047.284547:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.284756:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11418:x1870607923870464:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 8800us (9326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.284768:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 136 00010000:00010000:0.0:1783951047.285642:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285659:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285668:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285676:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.285699:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285709:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285730:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e0247827a00) 00010000:00010000:0.0:1783951047.285735:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.285740:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285747:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f8644 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285781:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285788:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285795:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285801:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.285804:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285810:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285832:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e024109ef00) 00010000:00010000:0.0:1783951047.285834:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.285844:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285851:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f86ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285872:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285879:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285885:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285891:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5de00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.285894:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285901:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285910:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:0.0:1783951047.285912:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.285914:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285920:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f876a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285931:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285948:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285955:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285960:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.285964:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285985:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.285995:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:0.0:1783951047.285998:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.286001:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286008:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f878d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286026:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286032:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286049:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286054:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.286064:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286071:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286079:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951047.286081:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.286084:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286090:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f885f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286102:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286108:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286113:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286118:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.286121:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286127:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286134:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:0.0:1783951047.286135:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951047.286957:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.286968:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f891c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.288844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.288891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.289017:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870592 00000100:00100000:3.0:1783951047.289031:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870592 00000100:00100000:3.0:1783951047.289120:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:3.0:1783951047.289132:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:2410:x1870607923870592:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783951047.291642:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1783951047.291662:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1783951047.291914:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2410:x1870607923870592:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 2776us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.291928:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:0.0:1783951047.293593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870720 00000100:00100000:0.0:1783951047.293613:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870720 00010000:00010000:1.0:1783951047.293830:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 7 pid: 8440 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.293880:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:1.0:1783951047.293890:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923870720:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951047.293910:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951047.293916:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 7 pid: 8440 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.293933:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 7 pid: 8440 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.293965:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052d3ead0/0x7645c8e1169f86fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f68f expref: 7 pid: 8440 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.293998:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951047.294003:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951047.294028:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.294045:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.294083:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951047.294469:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.294481:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.294492:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.294500:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.294525:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951047.294774:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944912128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13304us (13554us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783951047.294784:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951047.294882:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1783951047.294889:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1783951047.294916:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e024818b800, transno 4294967310 00000100:00100000:2.0:1783951047.294946:0:3654:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e024818ad80 x1870607944912128/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783951063 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783951047.294960:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e024818ad80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1783951047.294977:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944912128:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783951047.295085:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951047.295095:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.295105:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951047.295110:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.295120:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.295138:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.295171:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f36ab7/0x7645c8e1169f894d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.295194:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951047.295196:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951047.295198:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951047.295309:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923870720:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 1417us (6413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.295317:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:1.0:1783951047.299284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.299506:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923870976 00000100:00100000:2.0:1783951047.299519:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923870976 00000100:00100000:2.0:1783951047.299591:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:2.0:1783951047.299604:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11418:x1870607923870976:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783951047.299680:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951047.299717:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8931 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f729 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.299744:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:2.0:1783951047.299750:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951047.299790:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.299807:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.299891:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951047.300448:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0fb15a8 reply state 000000008f7d9289 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.300468:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.300500:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:2.0:1783951047.300503:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951047.300506:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951047.300641:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:11418:x1870607923870976:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1037us (1380us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1783951047.300650:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:0.0:1783951047.304372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.304583:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923871104 00000100:00100000:3.0:1783951047.304597:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923871104 00000100:00100000:3.0:1783951047.304667:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:3.0:1783951047.304680:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923871104:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783951047.304953:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783951047.304958:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1783951047 -> 1783951046 00002000:00010000:3.0:1783951047.304961:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783951046 00002000:00010000:3.0:1783951047.304963:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1783951047 -> 1783951046 00002000:00010000:3.0:1783951047.304981:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783951047.305363:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923871104:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 683us (1002us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783951047.305386:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:0.0:1783951047.308683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.308765:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923871360 00000100:00100000:2.0:1783951047.308776:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923871360 00000100:00100000:2.0:1783951047.308855:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1783951047.308867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:11418:x1870607923871360:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783951047.308955:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.308989:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 17 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.309000:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.309056:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 17 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.309072:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 17 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.309090:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944912512:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951047.309216:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0377bb6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951047.312568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.313269:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944912512:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951047.313306:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.313549:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923871488 00000100:00100000:3.0:1783951047.313559:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923871488 00010000:00010000:3.0:1783951047.313611:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 18 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.313666:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 75 00000100:00100000:3.0:1783951047.313677:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2408:x1870607923871488:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951047.313696:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951047.313704:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 18 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.313716:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 18 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.313741:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8915 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f71b expref: 18 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.313759:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:3.0:1783951047.313765:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.313777:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.313785:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.313843:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951047.313915:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:2408:x1870607923871488:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 239us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.313924:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 75 00010000:00010000:2.0:1783951047.314299:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314309:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314362:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314370:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314378:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314384:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951047.314390:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314398:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314408:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:2.0:1783951047.314412:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783951047.314416:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.314422:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f895b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.314481:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11418:x1870607923871360:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 Request processed in 5616us (5811us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783951047.314491:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:1.0:1783951047.317501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.317688:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923871616 00000100:00100000:3.0:1783951047.317699:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923871616 00000100:00100000:3.0:1783951047.317768:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1783951047.317779:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923871616:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783951047.317844:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.317869:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.317879:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951047.317884:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951047.317889:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.317935:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.317951:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 7 pid: 8439 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.317967:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1870607944912640:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951047.318342:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951047.321840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951047.321915:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923871744 00000100:00100000:2.0:1783951047.321927:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923871744 00010000:00010000:2.0:1783951047.321991:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 8 pid: 8439 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.322048:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:2.0:1783951047.322060:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923871744:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951047.322080:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951047.322110:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 8 pid: 8439 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.322125:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 8 pid: 8439 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.322455:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951047.322461:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951047.322470:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.322483:0:10402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.322532:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951047.322604:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923871744:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 544us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951047.322612:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 76 00010000:00010000:3.0:1783951047.324576:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097664742/0x7645c8e1169f893f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f737 expref: 7 pid: 8439 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.324609:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1870607944912640:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951047.324647:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324795:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324806:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324855:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324863:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324872:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324881:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951047.324886:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324895:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324945:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.324954:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025845ddf/0x7645c8e1169f8962 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.325086:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923871616:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 7307us (7596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951047.325097:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:1.0:1783951047.328513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.328671:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923872000 00000100:00100000:0.0:1783951047.328683:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923872000 00000100:00100000:0.0:1783951047.328794:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:0.0:1783951047.328807:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:11418:x1870607923872000:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783951047.328926:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.328946:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 16 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.328956:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.329014:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 16 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.329031:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 16 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951047.329246:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944912768:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951047.329346:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951047.333281:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.333691:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923872128 00000100:00100000:3.0:1783951047.333704:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923872128 00010000:00010000:3.0:1783951047.333760:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 17 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.333829:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 77 00000100:00100000:3.0:1783951047.333839:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:2408:x1870607923872128:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951047.333858:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951047.333866:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 17 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.333881:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 17 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.333908:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:3.0:1783951047.333915:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.333950:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.333959:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.333976:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.334000:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951047.334068:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:2408:x1870607923872128:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 230us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.334077:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 77 00010000:00010000:1.0:1783951047.334467:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8858 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6e3 expref: 16 pid: 10105 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.334489:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944912768:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951047.334515:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334526:0:11194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334532:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334779:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334802:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334823:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334859:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.334875:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 16 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.334891:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944912896:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951047.334964:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951047.337941:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944912896:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951047.337995:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.340044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.340198:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923872256 00000100:00100000:0.0:1783951047.340210:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923872256 00010000:00010000:0.0:1783951047.340266:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 17 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951047.340309:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:0.0:1783951047.340337:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+17:2407:x1870607923872256:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951047.340355:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951047.340363:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 17 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.340377:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 17 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.340403:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8923 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f722 expref: 17 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.340423:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:0.0:1783951047.340428:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.340440:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.340448:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.340475:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951047.340772:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:2407:x1870607923872256:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 433us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951047.340780:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 78 00010000:00010000:2.0:1783951047.341082:0:11194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.341091:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951047.341279:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1783951047.341431:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1783951047.341475:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1783951047.341576:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944913024:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783951047.341646:0:11194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951047.341687:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0341254e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951047.342412:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944913024 00000100:00100000:0.0:1783951047.342424:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944913024 00000100:00100000:0.0:1783951047.342492:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783951047.342502:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11194:x1870607944913024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783951047.342634:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11194:x1870607944913024:12345-0@lo:1000:mdt00_004.0 Request processed in 133us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951047.342642:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783951047.342769:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944913024:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1783951047.342962:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1783951047.343054:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944913152:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783951047.343091:0:11194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951047.343123:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951047.343361:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944913152 00000100:00100000:3.0:1783951047.343367:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944913152 00000100:00100000:3.0:1783951047.343406:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783951047.343414:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11194:x1870607944913152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783951047.343546:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:11194:x1870607944913152:12345-0@lo:1000:mdt00_004.0 Request processed in 133us (454us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783951047.343553:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783951047.343666:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944913152:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1783951047.343713:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343724:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343733:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343740:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951047.343746:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343754:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343773:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:2.0:1783951047.343776:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951047.343782:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343789:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f8970 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343835:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343841:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343848:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343853:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951047.343856:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343862:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343870:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951047.343872:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951047.343880:0:11194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343892:0:11194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343902:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951047.343931:0:11194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.343955:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944913280:192.168.202.33@tcp:105: 00000100:00100000:2.0:1783951047.344601:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351ce9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951047.349838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.350069:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923872384 00000100:00100000:0.0:1783951047.350081:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923872384 00000100:00100000:0.0:1783951047.350171:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:0.0:1783951047.350183:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11417:x1870607923872384:12345-192.168.202.33@tcp:49:lfs.0 00000100:00100000:0.0:1783951047.350372:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:11417:x1870607923872384:12345-192.168.202.33@tcp:49:lfs.0 Request processed in 190us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951047.350381:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:1.0:1783951047.351841:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944913280:192.168.202.33@tcp:105: 00010000:00010000:1.0:1783951047.351885:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.351898:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f88b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.351945:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.351962:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352324:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352355:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352362:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352369:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352375:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951047.352379:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352387:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352400:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951047.352404:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951047.352408:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352414:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f8977 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352428:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352433:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352439:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352450:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951047.352453:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352458:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352466:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951047.352468:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951047.352471:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.352477:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8969 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951047.352730:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:11418:x1870607923872000:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 23922us (24226us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1783951047.352742:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 139 00000020:00080000:1.0:1783951047.352749:0:11194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783951047.352927:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951047.352934:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951047.353591:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783951047.353606:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951047.358512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.358609:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923872640 00000100:00100000:1.0:1783951047.358621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923872640 00000100:00100000:1.0:1783951047.358691:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:1.0:1783951047.358701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:11417:x1870607923872640:12345-192.168.202.33@tcp:58:lfs.0 00000040:00080000:1.0:1783951047.358946:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1783951047.359081:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:11417:x1870607923872640:12345-192.168.202.33@tcp:58:lfs.0 Request processed in 380us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.359090:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:1.0:1783951047.360952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.361192:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923872896 00000100:00100000:0.0:1783951047.361203:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923872896 00000100:00100000:0.0:1783951047.361542:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1783951047.361554:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:11418:x1870607923872896:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783951047.361916:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783951047.361959:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1783951047.362016:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.362217:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.362235:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.362245:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.362345:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.362351:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.362414:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783951047.362551:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:11418:x1870607923872896:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 997us (1610us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1783951047.362561:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000020:00080000:0.0:1783951047.362567:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783951047.364238:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951047.364253:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.364625:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951047.364631:0:9537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.364642:0:9537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.364663:0:9537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:1.0:1783951047.364666:0:9537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951047.364671:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.364678:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f897e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951047.364698:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951047.364700:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951047.364702:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951047.400902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951047.401029:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873024 00000100:00100000:0.0:1783951047.401053:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873024 00000100:00100000:0.0:1783951047.401132:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:0.0:1783951047.401190:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:11420:x1870607923873024:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951047.401228:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951047.401268:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f73e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401359:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401380:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401395:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401415:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401442:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401450:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401552:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401565:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401575:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401619:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.401635:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 22 pid: 6527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951047.401652:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944913408:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951047.401780:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951047.405087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.405428:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873280 00000100:00100000:3.0:1783951047.405440:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873280 00000100:00100000:3.0:1783951047.405520:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:3.0:1783951047.405533:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:6179:x1870607923873280:12345-192.168.202.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783951047.405930:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:6179:x1870607923873280:12345-192.168.202.33@tcp:35:ldlm_bl.0 Request processed in 400us (856us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783951047.405940:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:0.0:1783951047.406471:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944913408:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951047.406509:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951047.409381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.409476:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873408 00000100:00100000:3.0:1783951047.409487:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873408 00010000:00010000:3.0:1783951047.409547:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 24 pid: 6527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951047.409627:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:3.0:1783951047.409639:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:2407:x1870607923873408:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951047.409658:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951047.409666:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 24 pid: 6527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.409680:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 24 pid: 6527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.409707:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f88a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f6ff expref: 24 pid: 6527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.409728:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:3.0:1783951047.409734:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.409745:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.409754:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951047.409806:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951047.409917:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.409935:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951047.410023:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783951047.410029:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951047.410054:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410070:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410080:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410088:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410095:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410101:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.410106:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410114:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410124:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:0.0:1783951047.410127:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.410132:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410187:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f898c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410201:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410206:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410212:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410217:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951047.410220:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410226:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410235:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e024782e200) 00010000:00010000:0.0:1783951047.410238:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951047.410241:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410247:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8993 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410305:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8985 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f73e expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410320:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f73e expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951047.410332:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:0.0:1783951047.410334:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951047.410337:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5dc00, rc 0) 00000100:00100000:0.0:1783951047.410411:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:11420:x1870607923873024:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 9269us (9525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951047.410419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:3.0:1783951047.410770:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:2407:x1870607923873408:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 1132us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.410779:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:1.0:1783951047.439331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.439381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.439423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.439456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951047.439487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951047.439490:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873792 00000100:00100000:3.0:1783951047.439503:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873792 00000100:00100000:1.0:1783951047.439512:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923874048 00000100:00100000:1.0:1783951047.439515:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923874048 00000100:00100000:1.0:1783951047.439569:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873664 00000100:00100000:1.0:1783951047.439571:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873664 00000100:00100000:3.0:1783951047.439575:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 110 00000100:00100000:3.0:1783951047.439586:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2410:x1870607923873792:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951047.439589:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873920 00000100:00100000:1.0:1783951047.439608:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873920 00000100:00100000:1.0:1783951047.439627:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 285 00000100:00100000:1.0:1783951047.439633:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923874048:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951047.439683:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2410:x1870607923873792:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951047.439691:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 110 00000100:00100000:3.0:1783951047.439725:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 286 00000100:00100000:3.0:1783951047.439732:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923873664:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951047.439803:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923873536 00000100:00100000:0.0:1783951047.439808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923873536 00000100:00100000:0.0:1783951047.439855:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 384 00000100:00100000:0.0:1783951047.439862:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923873536:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951047.439912:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923874048:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 278us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.439920:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 285 00000100:00100000:1.0:1783951047.439935:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 287 00000100:00100000:1.0:1783951047.439942:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923873920:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951047.439986:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923873920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 44us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.439992:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 287 00000100:00080000:1.0:1783951047.440012:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951047.440017:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951047.444211:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923873664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4450us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.444232:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 286 00000100:00100000:1.0:1783951047.451008:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923873536:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 11093us (11639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951047.451030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 384 00010000:00010000:3.0:1783951047.776272:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951047.776479:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944913536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951047.776621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951047.777662:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944913536 00000100:00100000:0.0:1783951047.777674:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944913536 00000100:00100000:0.0:1783951047.777740:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783951047.777751:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944913536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951047.777792:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783951047.777865:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944913536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951047.777873:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783951047.778036:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944913536:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783951048.110945:0:14267:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951048.110955:0:14267:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951048.111004:0:14267:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783951048.111012:0:14267:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951048.290081:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944913664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951048.290165:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951048.290294:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944913664 00000100:00100000:3.0:1783951048.290302:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944913664 00000100:00100000:3.0:1783951048.290479:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783951048.290491:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944913664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951048.290532:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783951048.290755:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951048.290822:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944913664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 335us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951048.290830:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783951048.290891:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944913664:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1783951048.417788:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951048.417797:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951048.417833:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783951048.417842:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951048.417993:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944913792:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951048.418175:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951048.420584:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944913792:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951048.421633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951048.422647:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923874176 00000100:00100000:1.0:1783951048.422658:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923874176 00000100:00100000:1.0:1783951048.422787:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 142 00000100:00100000:1.0:1783951048.422798:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11433:x1870607923874176:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951048.422843:0:10105:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951048.422980:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11433:x1870607923874176:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 184us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951048.423000:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 142 00000100:00080000:2.0:1783951048.426902:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951048.428190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951048.428342:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923874432 00000100:00100000:1.0:1783951048.428352:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923874432 00000100:00100000:1.0:1783951048.428419:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:1.0:1783951048.428430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:11433:x1870607923874432:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951048.428453:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951048.428475:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f89a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f745 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.428595:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.428611:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.428625:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951048.428638:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783951048.428750:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f89a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f745 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.428773:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f745 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.428782:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951048.428785:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951048.428789:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030400, rc 0) 00000100:00100000:1.0:1783951048.428891:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:11433:x1870607923874432:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 461us (708us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1783951048.428899:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:3.0:1783951048.433197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951048.433536:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923874560 00000100:00100000:2.0:1783951048.433546:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923874560 00000100:00100000:2.0:1783951048.433606:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1783951048.433616:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343004850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:2407:x1870607923874560:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951048.433633:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951048.433659:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f745 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951048.433681:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951048.433687:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951048.433747:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343004850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:2407:x1870607923874560:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 132us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951048.433769:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:3.0:1783951048.441867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951048.441949:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923874816 00000100:00100000:1.0:1783951048.441969:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923874816 00000100:00100000:1.0:1783951048.442031:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:1.0:1783951048.442039:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:11433:x1870607923874816:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783951048.442120:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442170:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442183:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442469:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442478:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442486:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442491:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951048.442495:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442502:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442532:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951048.442535:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951048.442540:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951048.442547:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951048.442675:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:11433:x1870607923874816:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 635us (816us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783951048.442685:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 144 00000040:00080000:2.0:1783951048.442894:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951048.442899:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951048.444088:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783951048.444104:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951048.448532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951048.448672:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875072 00000100:00100000:0.0:1783951048.448682:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875072 00000100:00100000:0.0:1783951048.448742:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:0.0:1783951048.448752:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:11433:x1870607923875072:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951048.449089:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:11433:x1870607923875072:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 337us (566us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1783951048.449098:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:2.0:1783951048.800363:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944913920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951048.800439:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951048.800459:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951048.800483:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944913920 00000100:00100000:3.0:1783951048.800490:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944913920 00000100:00100000:3.0:1783951048.800548:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783951048.800558:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3655:x1870607944913920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951048.800581:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951048.800630:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3655:x1870607944913920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951048.800638:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783951048.800840:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03810e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944913920:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783951049.318181:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1783951049.318201:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:1.0:1783951049.824569:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951050.035701:0:14318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951050.035710:0:14318:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951050.035741:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783951050.035752:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783951050.294860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951050.294998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875328 00000100:00100000:1.0:1783951050.295007:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875328 00000100:00100000:1.0:1783951050.295186:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:1.0:1783951050.295198:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:11453:x1870607923875328:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951050.295225:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951050.295247:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f89bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f74c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.295377:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f89c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.295393:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f89c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.295415:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f89c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951050.295427:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783951050.295538:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030a00/0x7645c8e1169f89bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f74c expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.295556:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f89c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f74c expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.295565:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951050.295568:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783951050.295572:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031800, rc 0) 00000100:00100000:1.0:1783951050.295630:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:11453:x1870607923875328:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 434us (778us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1783951050.295638:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00080000:0.0:1783951050.296755:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951050.298100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951050.298989:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875456 00000100:00100000:2.0:1783951050.299000:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875456 00000100:00100000:2.0:1783951050.299113:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:2.0:1783951050.299125:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:11453:x1870607923875456:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:2.0:1783951050.299222:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299238:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299249:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299343:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299351:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299358:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299376:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951050.299380:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299387:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299399:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:2.0:1783951050.299402:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951050.299407:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951050.299412:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f89d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951050.299494:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:11453:x1870607923875456:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 370us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951050.299502:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:3.0:1783951050.390243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951050.390369:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875584 00000100:00100000:1.0:1783951050.390379:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875584 00000100:00100000:1.0:1783951050.390460:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:1.0:1783951050.390472:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923875584:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:1.0:1783951050.390490:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1783951050.390523:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783951050.390529:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac82027/0x7645c8e1169f89d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f753 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951050.390559:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a54eec6, atime: 0x6a54eec6, ctime: 0x6a54eec6, blocks: 0x8 00010000:00010000:1.0:1783951050.390580:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1783951050.390600:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951050.390611:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac82027/0x7645c8e1169f89d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f753 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.390630:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bac82027/0x7645c8e1169f89d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f753 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951050.390643:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030a00, rc 0) 00000100:00100000:1.0:1783951050.390717:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923875584:12345-192.168.202.33@tcp:101:cat.0 Request processed in 248us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951050.390723:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1783951050.396911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951050.397698:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875712 00000100:00100000:1.0:1783951050.397709:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875712 00002000:00100000:1.0:1783951050.397757:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9e0247b66d80 x1870607923875712/t0(0) o3->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:66/0 lens 488/0 e 0 to 0 dl 1783951061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951050.397767:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0247b66d80 with x1870607923875712 ext(0->4095) 00002000:00010000:1.0:1783951050.397772:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0247b66d80 00000100:00100000:1.0:1783951050.397803:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1783951050.397813:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2410:x1870607923875712:12345-192.168.202.33@tcp:3:cat.0 00000100:00100000:1.0:1783951050.398006:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2410:x1870607923875712:12345-192.168.202.33@tcp:3:cat.0 Request processed in 194us (1103us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783951050.398015:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00002000:00100000:1.0:1783951050.398021:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9e0247b66d80 x1870607923875712/t0(0) o3->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:66/0 lens 488/4536 e 0 to 0 dl 1783951061 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951050.398031:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0247b66d80 with x1870607923875712 ext(0->4095) 00002000:00010000:1.0:1783951050.398040:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0247b66d80 00000100:00100000:2.0:1783951050.850047:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1783951050.850161:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951050.850208:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951050.850225:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944914304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951050.850283:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951050.850351:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914304 00000100:00100000:3.0:1783951050.850358:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914304 00000100:00100000:3.0:1783951050.850422:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783951050.850446:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944914304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951050.850474:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783951050.850527:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944914304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951050.850535:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783951050.850581:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944914304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951050.850623:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944914432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951050.850641:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951050.850661:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914432 00000100:00100000:3.0:1783951050.850664:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914432 00000100:00100000:3.0:1783951050.850683:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783951050.850701:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944914432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951050.850724:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783951050.850755:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944914432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951050.850760:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783951050.850791:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944914432:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1783951050.850812:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951050.851268:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944914560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951050.851296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.851320:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951050.851327:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944914176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.851354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.851383:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914176 00000100:00100000:0.0:1783951050.851388:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914176 00000100:00100000:0.0:1783951050.851417:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783951050.851423:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944914176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.851448:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944914176:12345-0@lo:400:kworker.0 Request processed in 27us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951050.851453:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783951050.851471:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944914176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.851482:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914560 00000100:00100000:0.0:1783951050.851484:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914560 00000100:00100000:0.0:1783951050.851502:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783951050.851516:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944914560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951050.851540:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783951050.851571:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944914560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951050.851576:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783951050.851598:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944914560:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783951050.851609:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951050.853858:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944914048:0@lo:400:kworker.0 00000100:00100000:2.0:1783951050.854588:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.854709:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914048 00000100:00100000:0.0:1783951050.854717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914048 00000100:00100000:0.0:1783951050.854773:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1783951050.854790:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944914048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.854848:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944914048:12345-0@lo:400:kworker.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951050.854856:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1783951050.855272:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944914048:0@lo:400:kworker.0 00000100:00100000:2.0:1783951050.859562:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944914688:0@lo:400:kworker.0 00000100:00100000:2.0:1783951050.859633:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.859725:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914688 00000100:00100000:0.0:1783951050.859733:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914688 00000100:00100000:1.0:1783951050.860191:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1783951050.860203:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944914688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951050.860256:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944914688:12345-0@lo:400:kworker.0 Request processed in 55us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951050.860263:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1783951050.860286:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944915072:0@lo:400:kworker.0 00000100:00100000:1.0:1783951050.860313:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951050.860334:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944915584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951050.860354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951050.860373:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951050.860379:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944915200:0@lo:400:kworker.0 00000100:00100000:1.0:1783951050.860403:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951050.860432:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915200 00000100:00100000:1.0:1783951050.860436:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915200 00000100:00100000:1.0:1783951050.860480:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783951050.860487:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944915200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951050.860621:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944915200:12345-0@lo:400:kworker.0 Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951050.860628:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783951050.860650:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915072 00000100:00100000:1.0:1783951050.860653:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915072 00000100:00100000:1.0:1783951050.860676:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915584 00000100:00100000:1.0:1783951050.860679:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915584 00000100:00100000:1.0:1783951050.860697:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783951050.860703:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944915072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951050.860734:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944915072:12345-0@lo:400:kworker.0 Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951050.860754:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783951050.860767:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1783951050.860772:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944915584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.860889:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944914816:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861035:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.861056:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944915328:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.861094:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783951050.861100:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944914944:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.861136:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944915456:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861171:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951050.861190:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914816 00000100:00100000:0.0:1783951050.861199:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914816 00000100:00100000:0.0:1783951050.861225:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783951050.861230:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944914816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861262:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944914816:12345-0@lo:400:kworker.0 Request processed in 32us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951050.861267:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783951050.861297:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944914816:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861320:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944914944 00000100:00100000:0.0:1783951050.861323:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944914944 00000100:00100000:0.0:1783951050.861339:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915456 00000100:00100000:0.0:1783951050.861341:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915456 00000100:00100000:0.0:1783951050.861353:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1783951050.861358:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944914944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861389:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944914944:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951050.861394:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1783951050.861405:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1783951050.861410:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944915456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861435:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944915456:12345-0@lo:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951050.861440:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1783951050.861465:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944914944:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.861474:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944915456:0@lo:400:kworker.0 00000100:00080000:3.0:1783951050.861705:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951050.861710:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951050.861713:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951050.861730:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915328 00000100:00100000:3.0:1783951050.861734:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915328 00000100:00100000:3.0:1783951050.861770:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783951050.861777:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944915328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951050.861829:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944915328:12345-0@lo:400:kworker.0 Request processed in 53us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951050.861842:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1783951050.861872:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951050.862247:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944915584:12345-0@lo:400:kworker.0 Request processed in 1474us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951050.862254:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1783951050.862295:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1783951050.862301:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1783951050.862319:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0247a2a300, transno 4294967302 00000004:00080000:1.0:1783951050.862327:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1783951050.862337:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0247b64380, transno 4294967305 00000100:00100000:1.0:1783951050.862342:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944915328:0@lo:400:kworker.0 00000100:00100000:0.0:1783951050.862424:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944915200:0@lo:400:kworker.0 00010000:00080000:0.0:1783951050.862439:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fdd8380 x1870607944915072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951050.862456:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944915072:0@lo:400:kworker.0 00010000:00080000:0.0:1783951050.862469:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0341219880 x1870607944915584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951050.862476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944915584:0@lo:400:kworker.0 00000100:00100000:2.0:1783951050.863235:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944914688:0@lo:400:kworker.0 00010000:00010000:0.0:1783951051.872639:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951052.554427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951052.554614:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876224 00000100:00100000:3.0:1783951052.554626:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876224 00000100:00100000:3.0:1783951052.554694:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876352 00000100:00100000:3.0:1783951052.554698:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876352 00000100:00100000:3.0:1783951052.554721:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:3.0:1783951052.554735:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923876224:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951052.554838:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923876224:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951052.554848:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:3.0:1783951052.554868:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:3.0:1783951052.554877:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923876352:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951052.554902:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923876352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951052.554909:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:3.0:1783951052.554940:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875968 00000100:00100000:3.0:1783951052.554943:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875968 00000100:00100000:3.0:1783951052.554974:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876480 00000100:00100000:3.0:1783951052.554987:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876480 00000100:00100000:3.0:1783951052.555004:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876096 00000100:00100000:3.0:1783951052.555006:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876096 00000100:00100000:3.0:1783951052.555020:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876608 00000100:00100000:3.0:1783951052.555022:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876608 00000100:00100000:3.0:1783951052.555038:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 294 00000100:00100000:3.0:1783951052.555044:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:2407:x1870607923875968:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951052.555076:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:2407:x1870607923875968:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951052.555082:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 294 00000100:00100000:3.0:1783951052.555094:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 295 00000100:00100000:3.0:1783951052.555100:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923876480:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951052.555127:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923876480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951052.555133:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 295 00000100:00100000:3.0:1783951052.555169:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 296 00000100:00100000:3.0:1783951052.555176:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923876096:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951052.555201:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923876096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951052.555207:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 296 00000100:00100000:3.0:1783951052.555219:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 297 00000100:00100000:3.0:1783951052.555225:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923876608:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951052.555245:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923876608:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951052.555252:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 297 00000100:00080000:3.0:1783951052.555290:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951052.555295:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951052.555297:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951052.555299:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951052.556023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923875840 00000100:00100000:1.0:1783951052.556033:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923875840 00000100:00100000:1.0:1783951052.556085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 386 00000100:00100000:1.0:1783951052.556093:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923875840:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951052.556171:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923875840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951052.556178:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 386 00010000:00010000:1.0:1783951052.896319:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951052.902235:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944915712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951052.902702:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951052.906411:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915712 00000100:00100000:1.0:1783951052.906433:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915712 00000100:00100000:1.0:1783951052.906523:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783951052.906537:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944915712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951052.906599:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783951052.914427:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944915712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7875us (11707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951052.914447:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783951052.917970:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944915712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951053.414262:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944915840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951053.414385:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951053.414424:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915840 00000100:00100000:3.0:1783951053.414435:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915840 00000100:00100000:3.0:1783951053.414519:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783951053.414537:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944915840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951053.414579:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951053.414639:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944915840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951053.414648:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783951053.414707:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944915840:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783951053.416006:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783951053.418686:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1783951053.418708:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1783951053.419804:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1783951053.419848:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e03432ccc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1783951053.419855:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0246a54500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e03432cca80 00000020:00080000:2.0:1783951053.419858:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0246a54f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e024806ec00 00000020:00080000:2.0:1783951053.419888:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1783951053.420245:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1783951053.420353:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1783951053.422019:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.422039:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.422048:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.422054:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951053.422059:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.422066:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.422086:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e0247828a00) 00010000:00010000:1.0:1783951053.422089:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951053.422094:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.422099:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8954 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951053.920379:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951053.923941:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944915968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951053.924047:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951053.924113:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944915968 00000100:00100000:3.0:1783951053.924127:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944915968 00000100:00080000:1.0:1783951053.924207:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951053.924251:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783951053.924268:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944915968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951053.924295:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951053.933033:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03810e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944915968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8761us (8976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951053.933048:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783951053.933508:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944915968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783951054.946837:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951054.988882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951054.988942:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876736 00000100:00100000:3.0:1783951054.988966:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876736 00000100:00100000:3.0:1783951054.989049:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 147 00000100:00100000:3.0:1783951054.989066:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:11106:x1870607923876736:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783951054.989359:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:11106:x1870607923876736:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 298us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951054.989368:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 147 00000100:00080000:3.0:1783951054.989395:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951054.994386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951054.995306:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923876864 00000100:00100000:3.0:1783951054.995324:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923876864 00000100:00100000:3.0:1783951054.996435:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00080000:0.0:1783951054.996576:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951054.997635:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:11106:x1870607923876864:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783951054.997807:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:11106:x1870607923876864:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 1358us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951054.997820:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00100000:1.0:1783951055.001995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951055.002080:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877120 00000100:00100000:0.0:1783951055.002091:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877120 00000100:00100000:0.0:1783951055.002345:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:0.0:1783951055.002359:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:11106:x1870607923877120:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951055.002706:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:11106:x1870607923877120:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 347us (719us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1783951055.002715:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:3.0:1783951055.263281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951055.263489:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877248 00000100:00100000:1.0:1783951055.263514:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877248 00000100:00100000:1.0:1783951055.263589:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 149 00000100:00100000:1.0:1783951055.263601:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+5:11912:x1870607923877248:12345-192.168.202.33@tcp:101:lsof.0 00010000:00010000:1.0:1783951055.263622:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951055.263645:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f75a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951055.263709:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951055.263723:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951055.263733:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951055.263929:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1783951055.264045:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951055.264049:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951055.264086:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951055.264111:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f89e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951055.264131:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951055.264139:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:1.0:1783951055.264193:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951055.264197:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030800, rc 0) 00000100:00100000:1.0:1783951055.264266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7ffa451-5324-4858-a00e-bb5627316d28+6:11912:x1870607923877248:12345-192.168.202.33@tcp:101:lsof.0 Request processed in 667us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951055.264273:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 149 00000040:00080000:3.0:1783951055.649614:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783951055.649623:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951055.649644:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783951055.649654:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783951055.968392:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951055.969271:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951055.969550:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951055.969574:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944916096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951055.969645:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951055.969762:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916096 00000100:00100000:1.0:1783951055.969771:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916096 00000100:00100000:1.0:1783951055.969837:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783951055.969846:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944916096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951055.969879:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783951055.969949:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944916096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951055.969956:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783951055.970010:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944916096:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783951055.970113:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951055.970749:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944916352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.970795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951055.970819:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944916864:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.970841:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951055.970865:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944917376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.970885:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951055.970939:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783951055.970945:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944916480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.970970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951055.971182:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916352 00000100:00100000:2.0:1783951055.971188:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916352 00000100:00100000:2.0:1783951055.971229:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916864 00000100:00100000:2.0:1783951055.971232:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916864 00000100:00100000:2.0:1783951055.971254:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917376 00000100:00100000:2.0:1783951055.971257:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917376 00000100:00100000:2.0:1783951055.971272:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783951055.971279:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944916352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.971347:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944916992:0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.971413:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944916608:0@lo:400:kworker.0 00000100:00100000:1.0:1783951055.971509:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1783951055.971518:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944916864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.975663:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944916352:12345-0@lo:400:kworker.0 Request processed in 4372us (4856us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.975679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783951055.975734:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783951055.975748:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944917376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.975806:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944917376:12345-0@lo:400:kworker.0 Request processed in 63us (4918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.975812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783951055.975837:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951055.975853:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944917888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951055.975906:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951055.975971:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951055.975987:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944916224:0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976018:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951055.976040:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944916736:0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976064:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951055.976084:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944917248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976106:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951055.976126:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944917760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951055.976182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951055.976219:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916224 00000100:00100000:2.0:1783951055.976226:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916224 00000100:00100000:2.0:1783951055.976260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1783951055.976266:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944916224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944916224:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.976305:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1783951055.976330:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916480 00000100:00100000:2.0:1783951055.976333:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916480 00000100:00100000:2.0:1783951055.976356:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916736 00000100:00100000:2.0:1783951055.976359:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916736 00000100:00100000:2.0:1783951055.976370:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917760 00000100:00100000:2.0:1783951055.976372:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917760 00000100:00100000:2.0:1783951055.976381:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783951055.976386:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944916480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976419:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944916480:12345-0@lo:400:kworker.0 Request processed in 32us (5447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.976425:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783951055.976436:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783951055.976442:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944916736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976467:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944916736:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.976472:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783951055.976482:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783951055.976487:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944917760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951055.976511:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1783951055.976536:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944917760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.976542:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783951055.976574:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944916224:0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976585:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944916736:0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976598:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944917760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951055.976661:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917248 00000100:00100000:2.0:1783951055.976664:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917248 00000100:00100000:2.0:1783951055.976699:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783951055.976705:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944917248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976736:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944917248:12345-0@lo:400:kworker.0 Request processed in 32us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.976742:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1783951055.976755:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951055.976770:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944917248:0@lo:400:kworker.0 00000100:00100000:2.0:1783951055.976815:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917888 00000100:00100000:2.0:1783951055.976818:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917888 00000100:00100000:2.0:1783951055.976847:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783951055.976853:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944917888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951055.976866:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783951055.976912:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944917888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951055.976919:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1783951055.976931:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951055.976946:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1783951055.976950:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e024818ad80, transno 4294967311 00000004:00080000:2.0:1783951055.976961:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1783951055.976982:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944917888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951055.982887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951055.982952:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944917504:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.982992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951055.983042:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944916352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.983058:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944917376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.983088:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944916480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.983126:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916992 00000100:00100000:3.0:1783951055.983132:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916992 00000100:00100000:3.0:1783951055.983202:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917504 00000100:00100000:3.0:1783951055.983206:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917504 00000100:00100000:3.0:1783951055.983236:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1783951055.983245:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944916992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.983301:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944916992:12345-0@lo:400:kworker.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951055.983308:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1783951055.983323:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1783951055.983330:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944917504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.983359:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944917504:12345-0@lo:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951055.983365:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:3.0:1783951055.983387:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783951055.983423:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248160000 x1870607944916992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951055.983434:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944916992:0@lo:400:kworker.0 00010000:00080000:3.0:1783951055.983444:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248011f80 x1870607944917504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951055.983453:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944917504:0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.985446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951055.985505:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944917120:0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.985547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951055.985570:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944917632:0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.985592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951055.985637:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917120 00000100:00100000:0.0:1783951055.985644:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917120 00000100:00100000:0.0:1783951055.985698:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944917632 00000100:00100000:0.0:1783951055.985702:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944917632 00000100:00100000:0.0:1783951055.985723:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783951055.985730:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944917120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.985793:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944917120:12345-0@lo:400:kworker.0 Request processed in 62us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951055.985800:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783951055.985816:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783951055.985822:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944917632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.985863:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944917632:12345-0@lo:400:kworker.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951055.985868:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1783951055.985899:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951055.985926:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944917632:0@lo:400:kworker.0 00000100:00100000:0.0:1783951055.985949:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944917120:0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.987930:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944916608 00000100:00100000:3.0:1783951055.987943:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944916608 00000100:00100000:3.0:1783951055.988022:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783951055.988033:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944916608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951055.988128:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944916608:12345-0@lo:400:kworker.0 Request processed in 97us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951055.988135:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1783951055.988556:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944916608:0@lo:400:kworker.0 00000100:00100000:1.0:1783951055.990036:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944916864:12345-0@lo:400:kworker.0 Request processed in 18512us (19186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951055.990050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1783951055.990402:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944916864:0@lo:400:kworker.0 00010000:00010000:1.0:1783951056.995657:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951057.668681:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668821:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668871:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951057.668960:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877632 00000100:00100000:3.0:1783951057.668975:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877632 00000100:00100000:3.0:1783951057.669075:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878144 00000100:00100000:3.0:1783951057.669079:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878144 00000100:00100000:3.0:1783951057.669094:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877504 00000100:00100000:3.0:1783951057.669115:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877504 00000100:00100000:3.0:1783951057.669185:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878016 00000100:00100000:3.0:1783951057.669189:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878016 00000100:00100000:3.0:1783951057.669211:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 304 00000100:00100000:3.0:1783951057.669224:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923877632:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951057.669340:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923877632:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951057.669349:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 304 00000100:00100000:3.0:1783951057.669368:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 305 00000100:00100000:3.0:1783951057.669375:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923878144:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951057.669408:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923878144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 34us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951057.669414:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 305 00000100:00100000:3.0:1783951057.669427:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 306 00000100:00100000:3.0:1783951057.669434:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:2407:x1870607923877504:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951057.669466:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:2407:x1870607923877504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 33us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951057.669472:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 306 00000100:00100000:3.0:1783951057.669483:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 307 00000100:00100000:3.0:1783951057.669489:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2407:x1870607923878016:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951057.669511:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2407:x1870607923878016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951057.669518:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 307 00000100:00100000:0.0:1783951057.669808:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877376 00000100:00100000:0.0:1783951057.669814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877376 00000100:00100000:0.0:1783951057.669861:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 388 00000100:00100000:0.0:1783951057.669870:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923877376:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951057.669922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923877376:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 53us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951057.669929:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 388 00000100:00100000:0.0:1783951057.669966:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877888 00000100:00100000:0.0:1783951057.669978:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877888 00000100:00100000:0.0:1783951057.670012:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923877760 00000100:00100000:0.0:1783951057.670015:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923877760 00000100:00100000:0.0:1783951057.670040:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:0.0:1783951057.670047:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923877888:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951057.670079:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923877888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 33us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951057.670085:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:0.0:1783951057.670097:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:0.0:1783951057.670103:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923877760:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951057.670126:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923877760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951057.670133:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00080000:0.0:1783951057.670180:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951057.670186:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951057.670189:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951057.670191:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783951058.017059:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951058.017400:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951058.017429:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944918016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951058.017526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951058.017641:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918016 00000100:00100000:2.0:1783951058.017652:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918016 00000100:00100000:2.0:1783951058.017722:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783951058.017735:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944918016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951058.017785:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783951058.017847:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944918016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951058.017967:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783951058.018028:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02469db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944918016:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783951058.203565:0:14516:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:57:36 (1783951056) 00000100:00100000:2.0:1783951058.528862:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951058.528925:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944918144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951058.529046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951058.529320:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918144 00000100:00100000:3.0:1783951058.529353:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918144 00000100:00100000:3.0:1783951058.529441:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783951058.529458:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944918144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951058.529503:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951058.529561:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944918144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951058.529570:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1783951058.530805:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951058.530901:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944918144:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783951059.040874:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951059.041332:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951059.043431:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944918272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951059.043532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951059.043792:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918272 00000100:00100000:3.0:1783951059.043802:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918272 00000100:00100000:3.0:1783951059.043904:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783951059.043922:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944918272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951059.043955:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951059.044010:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944918272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951059.044016:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783951059.044104:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944918272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783951059.044159:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951059.259299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951059.259365:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878400 00000100:00100000:0.0:1783951059.259379:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878400 00000100:00100000:0.0:1783951059.259524:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 150 00000100:00100000:0.0:1783951059.259538:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:12179:x1870607923878400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951059.259565:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951059.259621:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f89ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f761 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259721:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259739:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259754:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259774:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259783:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259790:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259933:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259944:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.259951:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951059.259963:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783951059.260089:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260108:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260115:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260121:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951059.260125:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260133:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260193:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e0247832c00) 00010000:00010000:0.0:1783951059.260197:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951059.260203:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260208:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f89f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260231:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260238:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260245:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260250:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951059.260260:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260268:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260277:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e024782eb00) 00010000:00010000:0.0:1783951059.260279:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951059.260282:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260288:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f89fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260691:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f89ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f761 expref: 17 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260712:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f761 expref: 16 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.260721:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951059.260724:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951059.260727:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d200, rc 0) 00000100:00100000:0.0:1783951059.260806:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:12179:x1870607923878400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1271us (1520us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783951059.260816:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 150 00000001:00080000:3.0:1783951059.263024:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:3.0:1783951059.263048:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1783951059.263091:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1783951059.263104:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783951059.264025:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00080000:2.0:1783951059.264028:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951059.264105:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878528 00000100:00100000:3.0:1783951059.264119:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878528 00000100:00100000:3.0:1783951059.264357:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 151 00000100:00100000:3.0:1783951059.264371:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:12179:x1870607923878528:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783951059.264522:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:12179:x1870607923878528:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 153us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951059.264530:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 151 00000100:00100000:3.0:1783951059.266833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951059.266945:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878656 00000100:00100000:0.0:1783951059.266974:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878656 00000100:00100000:0.0:1783951059.267106:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:0.0:1783951059.267118:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:2407:x1870607923878656:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951059.267138:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951059.267194:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f761 expref: 14 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951059.267218:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951059.267225:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951059.267344:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:2407:x1870607923878656:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 227us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951059.267353:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:1.0:1783951059.268552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951059.268668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878784 00000100:00100000:0.0:1783951059.268679:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878784 00000100:00100000:0.0:1783951059.268801:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 152 00000100:00100000:0.0:1783951059.268811:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:12179:x1870607923878784:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783951059.268943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:12179:x1870607923878784:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 133us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951059.268952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 152 00000100:00080000:2.0:1783951059.269000:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1783951059.745496:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951059.745509:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951059.745534:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783951059.745545:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783951060.065609:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951060.068545:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951060.981447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951060.981532:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923878912 00000100:00100000:3.0:1783951060.981565:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923878912 00000100:00100000:3.0:1783951060.981640:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 153 00000100:00100000:3.0:1783951060.981653:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:12221:x1870607923878912:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951060.981682:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951060.981719:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8a11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f768 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981803:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981820:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981836:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981867:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981876:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981883:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981950:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981959:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981966:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981979:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951060.981984:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.981992:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982006:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:3.0:1783951060.982009:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951060.982015:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982021:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8a18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982583:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982592:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982599:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982604:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951060.982607:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982613:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982634:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e024109ed00) 00010000:00010000:3.0:1783951060.982637:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951060.982640:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982646:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8a1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982700:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8a11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f768 expref: 14 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982711:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:3.0:1783951060.982714:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951060.982718:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8a11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f768 expref: 14 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.982727:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145e00, rc 0) 00000100:00100000:3.0:1783951060.982988:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:12221:x1870607923878912:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1336us (1553us total) trans 0 rc 301/301 00000100:00100000:3.0:1783951060.982998:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 153 00000100:00100000:1.0:1783951060.988717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951060.988910:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923879168 00000100:00100000:3.0:1783951060.988923:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923879168 00000100:00100000:3.0:1783951060.989005:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 154 00000100:00100000:3.0:1783951060.989017:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:12221:x1870607923879168:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:3.0:1783951060.989103:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951060.989174:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8365 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f58c expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.989218:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:3.0:1783951060.989225:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951060.989755:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.989777:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 5 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.989786:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.989832:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 5 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951060.989881:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 5 pid: 6524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951060.989899:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944918400:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951060.990486:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03513359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951061.005710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.007714:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923879296 00000100:00100000:1.0:1783951061.007733:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923879296 00010000:00010000:1.0:1783951061.007807:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 6 pid: 6524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951061.007869:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 80 00000100:00100000:1.0:1783951061.007880:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2408:x1870607923879296:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951061.007900:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951061.007907:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 6 pid: 6524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.007922:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 6 pid: 6524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.007950:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:1.0:1783951061.007955:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.007966:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.007974:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.007998:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951061.008070:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7ffa451-5324-4858-a00e-bb5627316d28+6:2408:x1870607923879296:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 191us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.008088:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 80 00000100:00080000:2.0:1783951061.008444:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951061.011943:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f89e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f75a expref: 5 pid: 6524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951061.011974:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944918400:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951061.012013:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.013357:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.013376:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.013414:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.013428:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.013440:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015025:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015064:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015077:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951061.015100:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c0a52ab reply state 0000000032a593b6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015114:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015122:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951061.015125:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951061.015131:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951061.015139:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783951061.015171:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015179:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015186:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015193:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951061.015199:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015207:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.015233:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0246937d00) 00010000:00010000:2.0:1783951061.015235:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951061.016007:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.016019:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8a26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951061.016046:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c0a52ab reply state 0000000032a593b6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.016059:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.016066:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e0247828700) 00010000:00010000:2.0:1783951061.016068:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951061.016071:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783951061.017227:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:12221:x1870607923879168:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 27220us (27543us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1783951061.017314:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 154 00000100:00100000:3.0:1783951061.090221:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944918528:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.090554:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.090652:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918528 00000100:00100000:3.0:1783951061.090663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918528 00000100:00100000:3.0:1783951061.090732:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1783951061.090744:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944918528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.090809:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944918528:12345-0@lo:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.090818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1783951061.090895:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944918528:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.090937:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944918656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.090970:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.091007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918656 00000100:00100000:3.0:1783951061.091012:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918656 00000100:00100000:3.0:1783951061.091043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1783951061.091051:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944918656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.091089:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944918656:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.091096:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1783951061.091129:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944918656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.091236:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944919040:0@lo:400:kworker.0 00000100:00100000:1.0:1783951061.091710:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944918784:0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.091886:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944918912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.098221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.098328:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951061.098445:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944919168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951061.098527:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.098594:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919168 00000100:00100000:3.0:1783951061.098623:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919168 00000100:00100000:3.0:1783951061.098699:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783951061.098714:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944919168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951061.098759:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783951061.098811:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944919168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.098820:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1783951061.098856:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951061.098903:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944919168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951061.100593:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919040 00000100:00100000:0.0:1783951061.100611:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919040 00000100:00100000:0.0:1783951061.100683:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783951061.100716:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944919040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951061.100836:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944919040:12345-0@lo:400:kworker.0 Request processed in 123us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.100853:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783951061.100919:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944919040:0@lo:400:kworker.0 00000100:00100000:1.0:1783951061.107049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951061.107106:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918784 00000100:00100000:1.0:1783951061.107117:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918784 00000100:00100000:1.0:1783951061.107207:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783951061.107219:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944918784:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1783951061.107450:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951061.107553:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944918784:12345-0@lo:400:kworker.0 Request processed in 336us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.107563:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783951061.107621:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944918784:0@lo:400:kworker.0 00000100:00100000:1.0:1783951061.107636:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944919296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951061.107678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951061.109384:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919296 00000100:00100000:0.0:1783951061.109402:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919296 00000100:00100000:0.0:1783951061.109479:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783951061.109491:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944919296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951061.109522:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783951061.109618:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944919296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.109627:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1783951061.109655:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951061.109709:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944919296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951061.110540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.110708:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944919552:0@lo:400:kworker.0 00000100:00100000:1.0:1783951061.110759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951061.110911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951061.110937:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0343396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944919424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951061.110968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951061.111365:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923879424 00000100:00100000:0.0:1783951061.111374:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923879424 00000100:00100000:0.0:1783951061.111434:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919552 00000100:00100000:0.0:1783951061.111438:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919552 00000100:00100000:0.0:1783951061.111460:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944918912 00000100:00100000:0.0:1783951061.111463:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944918912 00000100:00100000:0.0:1783951061.111481:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783951061.111488:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944919552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.112090:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1783951061.112103:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944918912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.112181:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944918912:12345-0@lo:400:kworker.0 Request processed in 82us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951061.112210:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1783951061.112253:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 155 00000100:00100000:2.0:1783951061.112262:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+14:12229:x1870607923879424:12345-192.168.202.33@tcp:101:lctl.0 00010000:00010000:2.0:1783951061.112284:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951061.112315:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f76f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.112514:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f8a42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.112532:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f8a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.112547:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f8a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951061.112613:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951061.112618:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951061.112648:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f8a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.112678:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f76f expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.112703:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f8a42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f76f expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.112713:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:2.0:1783951061.112716:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951061.112728:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609400, rc 0) 00000100:00100000:2.0:1783951061.112783:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:12229:x1870607923879424:12345-192.168.202.33@tcp:101:lctl.0 Request processed in 522us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951061.112791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 155 00000100:00100000:2.0:1783951061.112862:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944918912:0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.113802:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944919680:0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.113896:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951061.113948:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919680 00000100:00100000:2.0:1783951061.113957:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919680 00000100:00100000:2.0:1783951061.114001:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1783951061.114012:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944919680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.114066:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944919680:12345-0@lo:400:kworker.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951061.114074:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00080000:2.0:1783951061.114115:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248300000 x1870607944919680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951061.114129:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944919680:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.114531:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951061.114540:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944920064:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.114571:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.114598:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944920064 00000100:00100000:3.0:1783951061.114601:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944920064 00000100:00100000:3.0:1783951061.114636:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1783951061.114642:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944920064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.114674:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944920064:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.114680:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1783951061.114707:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944920064:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.114740:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944920192:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.114763:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.114786:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944920192 00000100:00100000:3.0:1783951061.114789:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944920192 00000100:00100000:3.0:1783951061.114827:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783951061.114835:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944920192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.114897:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944920192:12345-0@lo:400:kworker.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.114904:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00080000:3.0:1783951061.114929:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248302300 x1870607944920192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951061.114939:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944920192:0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.115064:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944919936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.115099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951061.115134:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951061.115172:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944919808:0@lo:400:kworker.0 00000100:00100000:2.0:1783951061.115196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951061.115466:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919936 00000100:00100000:3.0:1783951061.115472:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919936 00000100:00100000:3.0:1783951061.115516:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919808 00000100:00100000:3.0:1783951061.115519:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919808 00000100:00100000:3.0:1783951061.115542:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783951061.115548:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944919936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.115591:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944919936:12345-0@lo:400:kworker.0 Request processed in 42us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.115598:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783951061.115610:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783951061.115617:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944919808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.115643:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944919808:12345-0@lo:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.115648:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783951061.115672:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944919808:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.115681:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944919936:0@lo:400:kworker.0 00000100:00100000:0.0:1783951061.115856:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944919552:12345-0@lo:400:kworker.0 Request processed in 4366us (5094us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.115865:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783951061.115944:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944919424 00000100:00100000:0.0:1783951061.115949:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944919424 00000100:00100000:0.0:1783951061.115984:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783951061.115991:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944919424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951061.116026:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783951061.116074:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944919424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.116081:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1783951061.116102:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951061.116107:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951061.116110:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951061.117640:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0343396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944919424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951061.127428:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944919552:0@lo:400:kworker.0 00000100:00100000:3.0:1783951061.199944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.200201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923879552 00000100:00100000:0.0:1783951061.200216:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923879552 00000100:00100000:0.0:1783951061.200445:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 156 00000100:00100000:0.0:1783951061.200460:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+15:12235:x1870607923879552:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951061.200491:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.200520:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f776 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201499:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201526:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201540:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201676:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201714:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201722:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201839:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201859:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201867:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951061.201921:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783951061.201926:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951061.201954:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201969:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201975:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201983:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.201989:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.201994:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.202010:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.202025:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:0.0:1783951061.202670:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.202680:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203432:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203457:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203464:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203472:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203480:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.203484:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203491:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203506:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e0247828700) 00010000:00010000:0.0:1783951061.203510:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.203513:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203541:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203788:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f776 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203809:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f776 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.203818:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951061.203821:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783951061.203824:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5ce00, rc 0) 00000100:00100000:2.0:1783951061.204118:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:12235:x1870607923879552:12345-192.168.202.33@tcp:101:bash.0 Request processed in 3657us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951061.204131:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 156 00000100:00100000:2.0:1783951061.208539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.209601:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923879808 00000100:00100000:0.0:1783951061.209617:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923879808 00000100:00100000:0.0:1783951061.209697:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 157 00000100:00100000:0.0:1783951061.209709:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+16:12235:x1870607923879808:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951061.209738:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.209764:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8a65 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f77d expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.209928:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.209945:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.209959:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.212972:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.212990:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213000:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951061.213328:0:11194:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1783951061.213704:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213711:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213717:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213745:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213750:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213755:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213761:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5de00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.213765:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213790:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213804:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951061.213808:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.213812:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213817:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951061.213828:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8bab46e reply state 0000000057522bcc transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213836:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213840:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:0.0:1783951061.213852:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951061.213856:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951061.213893:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8a65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 19 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213911:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 18 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.213918:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:0.0:1783951061.213920:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951061.213922:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951061.214091:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12235:x1870607923879808:12345-192.168.202.33@tcp:101:bash.0 Request processed in 4381us (5563us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1783951061.214100:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 157 00000100:00100000:1.0:1783951061.218757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951061.218858:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923879936 00000100:00100000:3.0:1783951061.218867:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923879936 00000100:00100000:3.0:1783951061.218944:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:3.0:1783951061.218954:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2408:x1870607923879936:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951061.218973:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951061.218992:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f784 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951061.219017:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951061.219036:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1783951061.219041:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951061.219050:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951061.219067:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951061.219079:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145e00, rc 0) 00000100:00100000:3.0:1783951061.219166:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923879936:12345-192.168.202.33@tcp:101:bash.0 Request processed in 188us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951061.219174:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00080000:0.0:1783951061.219522:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951061.222978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.223211:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923880064 00000100:00100000:0.0:1783951061.223220:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923880064 00000100:00100000:0.0:1783951061.223337:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:0.0:1783951061.223349:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:12235:x1870607923880064:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951061.223378:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.223399:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f78b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.223431:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.223440:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951061.223444:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951061.223450:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.223486:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.223500:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951061.223514:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1870607944920320:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951061.223623:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0344c0dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951061.227701:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1870607944920320:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951061.227738:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.227769:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5da00, rc 0) 00000100:00100000:0.0:1783951061.227829:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:12235:x1870607923880064:12345-192.168.202.33@tcp:101:bash.0 Request processed in 4482us (4858us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.227838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:1.0:1783951061.228956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951061.229038:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923880192 00000100:00100000:2.0:1783951061.229046:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923880192 00010000:00010000:2.0:1783951061.229084:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951061.229128:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:2.0:1783951061.229176:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923880192:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951061.229193:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951061.229218:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.229232:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.229256:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f36ab7/0x7645c8e1169f8a88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f784 expref: 7 pid: 8441 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.229273:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951061.229278:0:10402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951061.229286:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.229297:0:10402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.229376:0:10402:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951061.229391:0:10402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0343394e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10402:1870607944920448:192.168.202.33@tcp:105: 00000100:00100000:2.0:1783951061.229460:0:10402:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348898780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951061.240458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.240825:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923880448 00000100:00100000:0.0:1783951061.240834:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923880448 00000100:00100000:0.0:1783951061.240914:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:0.0:1783951061.240925:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12235:x1870607923880448:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:0.0:1783951061.241280:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:12235:x1870607923880448:12345-192.168.202.33@tcp:35:bash.0 Request processed in 355us (830us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1783951061.241288:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:2.0:1783951061.241457:0:10402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0343394e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10402:1870607944920448:192.168.202.33@tcp:105: 00010000:00010000:2.0:1783951061.241481:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951061.241504:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2407:x1870607923880192:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 12368us (12555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951061.241512:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:1.0:1783951061.342481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.342580:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923880704 00000100:00100000:0.0:1783951061.342588:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923880704 00000100:00100000:0.0:1783951061.342647:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 158 00000100:00100000:0.0:1783951061.342658:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:12245:x1870607923880704:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951061.342682:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.342709:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f792 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951061.342812:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783951061.346588:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f792 expref: 22 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.346610:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:1.0:1783951061.346626:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951061.346634:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f792 expref: 22 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.346649:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5de00, rc 0) 00000100:00100000:1.0:1783951061.346741:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12245:x1870607923880704:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 4083us (4267us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1783951061.346751:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 158 00000100:00100000:3.0:1783951061.353121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.353242:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923880960 00000100:00100000:0.0:1783951061.353275:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923880960 00000100:00100000:0.0:1783951061.353335:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:0.0:1783951061.353346:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12245:x1870607923880960:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951061.353582:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:12245:x1870607923880960:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 237us (480us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1783951061.353591:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:3.0:1783951061.420027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951061.420925:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923881088 00000100:00100000:2.0:1783951061.420938:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923881088 00000100:00100000:2.0:1783951061.421016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 159 00000100:00100000:2.0:1783951061.421028:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:12251:x1870607923881088:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951061.421054:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951061.421075:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8aa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f799 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.421189:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8aab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.421214:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.421232:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951061.421301:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783951061.421306:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951061.421329:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.421360:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8aa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f799 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.421384:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8aab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f799 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.421394:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951061.421397:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951061.421401:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608600, rc 0) 00000100:00100000:2.0:1783951061.421473:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:12251:x1870607923881088:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 447us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951061.421481:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 159 00000100:00100000:2.0:1783951061.427774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.427882:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923881344 00000100:00100000:0.0:1783951061.427892:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923881344 00000100:00100000:0.0:1783951061.427956:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 160 00000100:00100000:0.0:1783951061.427966:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:12251:x1870607923881344:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951061.427987:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.428008:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8ab2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7a0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.428131:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8ab9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.428187:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.428200:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951061.428211:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783951061.428327:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8ab2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a0 expref: 26 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.428345:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a0 expref: 25 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.428374:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:0.0:1783951061.428377:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951061.428380:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d600, rc 0) 00000100:00100000:0.0:1783951061.428436:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:12251:x1870607923881344:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 471us (672us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1783951061.428443:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 160 00000100:00100000:3.0:1783951061.431710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951061.432725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.434089:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923881728 00000100:00100000:0.0:1783951061.434105:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923881728 00000100:00100000:0.0:1783951061.434233:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 161 00000100:00100000:0.0:1783951061.434245:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:12251:x1870607923881728:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951061.434271:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.434292:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8ac7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7a7 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.434409:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8ace lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.434423:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8ace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.434436:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8ace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951061.434450:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783951061.434564:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8ac7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a7 expref: 28 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.434608:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8ace lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a7 expref: 27 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.434616:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:0.0:1783951061.434620:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783951061.434623:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c000, rc 0) 00000100:00100000:0.0:1783951061.434702:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12251:x1870607923881728:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 459us (1988us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1783951061.434710:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 161 00000100:00100000:3.0:1783951061.440110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.441367:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923881856 00000100:00100000:0.0:1783951061.441384:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923881856 00000100:00100000:0.0:1783951061.441472:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:0.0:1783951061.441483:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923881856:12345-192.168.202.33@tcp:1:lfs.0 00010000:00010000:0.0:1783951061.441527:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.441548:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.441558:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783951061.441562:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951061.441567:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.441607:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.441635:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 6 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951061.441651:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1870607944920576:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951061.441773:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951061.444621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923881472 00000100:00100000:1.0:1783951061.444634:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923881472 00000100:00100000:1.0:1783951061.444723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1783951061.444734:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:2410:x1870607923881472:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951061.444751:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951061.444778:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8ab9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a0 expref: 27 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.444801:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:1.0:1783951061.444806:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951061.444878:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:2410:x1870607923881472:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 146us (13178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.444886:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1783951061.445437:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fdd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1870607944920576:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951061.445461:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951061.445942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.446341:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923881984 00000100:00100000:1.0:1783951061.446364:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923881984 00002000:00100000:1.0:1783951061.446407:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9e0343395500 x1870607923881984/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:77/0 lens 504/0 e 0 to 0 dl 1783951072 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951061.446417:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0343395500 with x1870607923881984 ext(0->12) 00010000:00010000:1.0:1783951061.446426:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 7 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.446441:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 7 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951061.446448:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e0343395500 00000100:00100000:1.0:1783951061.446468:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:1.0:1783951061.446476:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923881984:12345-192.168.202.33@tcp:4:lfs.0 00000100:00100000:1.0:1783951061.447612:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923881984:12345-192.168.202.33@tcp:4:lfs.0 Request processed in 1131us (1666us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783951061.447623:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00002000:00100000:1.0:1783951061.447632:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9e0343395500 x1870607923881984/t4294967306(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:77/0 lens 504/448 e 0 to 0 dl 1783951072 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951061.447642:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0343395500 with x1870607923881984 ext(0->12) 00010000:00010000:1.0:1783951061.447651:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 9 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.447667:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 9 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951061.447703:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e0343395500 00000100:00100000:2.0:1783951061.454217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.454383:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923882112 00000100:00100000:0.0:1783951061.454392:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923882112 00010000:00010000:0.0:1783951061.454437:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 9 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951061.454489:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:0.0:1783951061.454500:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923882112:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951061.454516:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783951061.454535:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783951061.454539:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783951061 00002000:00010000:0.0:1783951061.454541:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783951061 00002000:00010000:0.0:1783951061.454543:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783951061 00002000:00010000:0.0:1783951061.454546:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783951061.454552:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 9 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.454568:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 9 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.454619:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8a8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f78b expref: 9 pid: 8439 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.454635:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951061.454640:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951061.454645:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.454654:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.454678:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951061.454742:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923882112:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 245us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.454751:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 82 00010000:00010000:1.0:1783951061.455017:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455028:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455050:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455059:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455067:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455075:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951061.455078:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455087:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455113:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.455135:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008da578e/0x7645c8e1169f8adc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951061.455236:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923881856:12345-192.168.202.33@tcp:1:lfs.0 Request processed in 13754us (15141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.455245:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:0.0:1783951061.458661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.458800:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923882368 00000100:00100000:1.0:1783951061.458810:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923882368 00000100:00100000:1.0:1783951061.458878:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:1.0:1783951061.458888:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:12251:x1870607923882368:12345-192.168.202.33@tcp:35:lfs.0 00000004:00010000:1.0:1783951061.458953:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8ace lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a7 expref: 26 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951061.459427:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1783951061.459470:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1783951061.462718:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1783951061.462795:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.462818:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 30 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.462827:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.462876:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 30 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.462914:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 30 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951061.462930:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1870607944920704:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951061.463384:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951061.472980:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1870607944920704:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951061.473009:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951061.475858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.476304:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923882496 00000100:00100000:1.0:1783951061.476314:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923882496 00010000:00010000:1.0:1783951061.476354:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 31 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951061.476396:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 83 00000100:00100000:1.0:1783951061.476406:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+31:2408:x1870607923882496:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951061.476421:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951061.476428:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 31 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.476441:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 31 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.476461:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8a7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f77d expref: 31 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.476499:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:1.0:1783951061.476505:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.476514:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.476530:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.476607:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951061.476665:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:2408:x1870607923882496:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 260us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.476673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 83 00010000:00010000:0.0:1783951061.481162:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.481182:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951061.481317:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1783951061.481453:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1783951061.481553:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fddad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944920832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783951061.481638:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951061.481670:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03512ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951061.481859:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944920832 00000100:00100000:1.0:1783951061.481867:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944920832 00000100:00100000:1.0:1783951061.481924:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783951061.481934:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1870607944920832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783951061.482024:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1870607944920832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.482033:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783951061.482266:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fddad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944920832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783951061.482403:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1783951061.482451:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0343397480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944920960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783951061.482483:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951061.482511:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348898e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951061.482579:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944920960 00000100:00100000:3.0:1783951061.482585:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944920960 00000100:00100000:3.0:1783951061.482622:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783951061.482630:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1870607944920960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783951061.482750:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1870607944920960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (266us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783951061.482757:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783951061.482881:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0343397480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944920960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783951061.482920:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1783951061.482956:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.482968:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.482977:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.482983:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951061.482988:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.482995:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.483011:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:2.0:1783951061.483014:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783951061.483018:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951061.483024:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8ae3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951061.483139:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783951061.483248:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1783951061.483261:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417131117913ns, next at 418131115610ns, rc = 0 00000001:00080000:2.0:1783951061.483269:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1783951061.483293:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e024782e000) 00010000:00010000:2.0:1783951061.483304:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783951061.483311:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8ace lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7a7 expref: 34 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951061.483412:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:12251:x1870607923882368:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 24525us (24760us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1783951061.483420:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000020:00080000:2.0:1783951061.483424:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783951061.486502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.486582:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923882624 00000100:00100000:1.0:1783951061.486591:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923882624 00000100:00100000:1.0:1783951061.486650:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 162 00000100:00100000:1.0:1783951061.486660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+33:12251:x1870607923882624:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951061.486684:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951061.486718:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8aea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7ae expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.486797:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8aea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ae expref: 34 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.486812:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8aea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ae expref: 34 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951061.486833:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951061.486836:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951061.486849:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031c00, rc 0) 00000100:00100000:1.0:1783951061.486906:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:12251:x1870607923882624:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 247us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.486912:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 162 00000100:00100000:2.0:1783951061.489995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.490092:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923882880 00000100:00100000:0.0:1783951061.490114:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923882880 00000100:00100000:0.0:1783951061.490204:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:0.0:1783951061.490215:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:12251:x1870607923882880:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951061.490470:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:12251:x1870607923882880:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 256us (484us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1783951061.490477:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:2.0:1783951061.604131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951061.604220:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923883136 00000100:00100000:3.0:1783951061.604231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923883136 00000100:00100000:3.0:1783951061.604349:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 163 00000100:00100000:3.0:1783951061.604362:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:12261:x1870607923883136:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951061.604396:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951061.604421:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8af1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7b5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951061.604562:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783951061.604681:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8af1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7b5 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951061.604705:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:3.0:1783951061.604709:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951061.604713:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8af1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7b5 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951061.604741:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:3.0:1783951061.604820:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:12261:x1870607923883136:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 461us (699us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1783951061.604852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 163 00000100:00100000:3.0:1783951061.607100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.607242:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923883264 00000100:00100000:0.0:1783951061.607250:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923883264 00000100:00100000:0.0:1783951061.607317:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 164 00000100:00100000:0.0:1783951061.607327:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:12261:x1870607923883264:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:0.0:1783951061.607400:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607418:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607430:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607443:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607451:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607476:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607555:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607564:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607570:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951061.607614:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607626:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607633:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607641:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607647:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.607652:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607660:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607671:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951061.607680:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.607686:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607693:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8aff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607706:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607711:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607717:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607722:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.607725:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607731:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607738:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:0.0:1783951061.607740:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.607743:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607749:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607773:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607786:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607793:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607797:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.607801:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607807:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607816:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951061.607818:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.607821:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.607827:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951061.608269:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:12261:x1870607923883264:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 941us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.608280:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 164 00000100:00100000:0.0:1783951061.610969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.611086:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923883520 00000100:00100000:1.0:1783951061.611095:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923883520 00000100:00100000:2.0:1783951061.616262:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:2.0:1783951061.616290:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+36:12261:x1870607923883520:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951061.616575:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:12261:x1870607923883520:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 297us (5612us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783951061.616591:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:2.0:1783951061.657543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.657675:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923883776 00000100:00100000:0.0:1783951061.657683:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923883776 00000100:00100000:0.0:1783951061.657761:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:0.0:1783951061.657772:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:12264:x1870607923883776:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951061.657817:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.657847:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7bc expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.657925:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.657939:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.657950:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.657960:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.657967:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.657974:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658077:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658085:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658091:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951061.658100:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783951061.658212:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658220:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658227:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658232:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.658236:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658244:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658256:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951061.658259:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.658263:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658269:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658282:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658287:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658293:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658307:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.658310:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658316:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658323:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:0.0:1783951061.658325:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951061.658327:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658332:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658367:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 40 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658382:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 39 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.658389:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951061.658391:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951061.658395:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951061.658517:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:12264:x1870607923883776:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 747us (982us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783951061.658525:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:3.0:1783951061.673738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.673979:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923883904 00000100:00100000:0.0:1783951061.674000:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923883904 00000100:00100000:0.0:1783951061.674062:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 166 00000100:00100000:0.0:1783951061.674072:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:12264:x1870607923883904:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:0.0:1783951061.674178:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674197:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674210:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674250:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674258:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674265:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674273:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951061.674277:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674285:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674297:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951061.674300:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951061.674305:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.674322:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951061.674397:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:12264:x1870607923883904:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 326us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951061.674406:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 166 00000100:00100000:1.0:1783951061.683929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951061.683996:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923884160 00000100:00100000:2.0:1783951061.684005:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923884160 00000100:00100000:2.0:1783951061.684067:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:2.0:1783951061.684078:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:12264:x1870607923884160:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951061.684351:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+40:12264:x1870607923884160:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 273us (429us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783951061.684358:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:2.0:1783951061.933811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951061.934028:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923884416 00000100:00100000:0.0:1783951061.934038:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923884416 00000100:00100000:0.0:1783951061.934100:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:0.0:1783951061.934110:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+40:12295:x1870607923884416:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:0.0:1783951061.934135:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951061.934188:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7c3 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.934303:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.934317:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.934329:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951061.934341:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783951061.934448:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7c3 expref: 43 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.934467:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7c3 expref: 42 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951061.934490:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951061.934493:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951061.934496:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d400, rc 0) 00000100:00100000:0.0:1783951061.934573:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12295:x1870607923884416:12345-192.168.202.33@tcp:101:cat.0 Request processed in 463us (771us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1783951061.934580:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:3.0:1783951061.941977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951061.942034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951061.942179:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923884544 00000100:00100000:1.0:1783951061.942190:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923884544 00000100:00100000:1.0:1783951061.942266:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:1.0:1783951061.942276:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343005c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:2410:x1870607923884544:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951061.942292:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783951061.942318:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923884800 00010000:00010000:1.0:1783951061.942319:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8b45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7c3 expref: 42 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951061.942325:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923884800 00010000:00010000:1.0:1783951061.942341:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951061.942348:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951061.942383:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:2.0:1783951061.942392:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12295:x1870607923884800:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:1.0:1783951061.942400:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343005c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:2410:x1870607923884544:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 125us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951061.942413:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783951061.942796:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12295:x1870607923884800:12345-192.168.202.33@tcp:35:cat.0 Request processed in 404us (760us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1783951061.942803:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:3.0:1783951062.023089:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.023312:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923885056 00000100:00100000:2.0:1783951062.023326:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923885056 00000100:00100000:2.0:1783951062.023410:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 168 00000100:00100000:2.0:1783951062.023423:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12301:x1870607923885056:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:2.0:1783951062.023456:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951062.023460:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783951062.023494:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8aab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f799 expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.023519:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951062.023524:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951062.023540:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8b53 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7ca expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.023692:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.023707:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 42 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.023716:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.023782:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 42 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.023798:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 42 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951062.023814:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944921088:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951062.024266:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951062.028475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.028613:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944921088:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951062.028649:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951062.028777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923885184 00000100:00100000:3.0:1783951062.028786:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923885184 00010000:00010000:3.0:1783951062.028851:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 43 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951062.029011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00100000:3.0:1783951062.029022:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:2407:x1870607923885184:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951062.029041:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951062.029050:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 43 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.029064:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 43 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.029088:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8b29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7bc expref: 43 pid: 11194 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.029103:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951062.029109:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.029184:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.029194:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.029225:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951062.029350:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:2407:x1870607923885184:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 328us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951062.029358:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 84 00010000:00010000:2.0:1783951062.030353:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.030366:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951062.030393:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783951062.030594:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8b53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.030617:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.030626:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:2.0:1783951062.030629:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951062.030645:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609000, rc 0) 00000100:00100000:2.0:1783951062.030784:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12301:x1870607923885056:12345-192.168.202.33@tcp:101:dd.0 Request processed in 7364us (7709us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783951062.030794:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 168 00000100:00100000:1.0:1783951062.034905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.035047:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923885312 00000100:00100000:0.0:1783951062.035070:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923885312 00000100:00100000:0.0:1783951062.035184:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 169 00000100:00100000:0.0:1783951062.035196:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12301:x1870607923885312:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:0.0:1783951062.035229:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951062.035256:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7d1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.035302:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.035320:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.035335:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.035506:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8b68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.035529:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.035547:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951062.035550:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951062.035555:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5da00, rc 0) 00000100:00100000:0.0:1783951062.035626:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:12301:x1870607923885312:12345-192.168.202.33@tcp:101:dd.0 Request processed in 433us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951062.035635:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 169 00000100:00100000:1.0:1783951062.039806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951062.039919:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923885568 00000100:00100000:3.0:1783951062.039933:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923885568 00000100:00100000:3.0:1783951062.040011:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 170 00000100:00100000:3.0:1783951062.040024:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:12301:x1870607923885568:12345-192.168.202.33@tcp:36:dd.0 00010000:00010000:3.0:1783951062.040409:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.040434:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.040448:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951062.040508:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1783951062.040535:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076d5993c reply state 00000000bf983fd6 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.040549:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.040578:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951062.040581:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951062.040586:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951062.040707:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+46:12301:x1870607923885568:12345-192.168.202.33@tcp:36:dd.0 Request processed in 685us (914us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1783951062.040715:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 170 00000020:00080000:3.0:1783951062.040721:0:11194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783951062.114445:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951062.328413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.328584:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923885696 00000100:00100000:2.0:1783951062.328597:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923885696 00000100:00100000:2.0:1783951062.328670:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 171 00000100:00100000:2.0:1783951062.328735:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+46:12315:x1870607923885696:12345-192.168.202.33@tcp:101:stat.0 00010000:00010000:2.0:1783951062.328768:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951062.328968:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8b7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7d8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.329064:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.329083:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.329097:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.329108:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.329115:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.329122:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.329713:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.329730:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.329738:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.329781:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.329806:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 47 pid: 6526 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951062.329823:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248303800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944921216:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951062.330026:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951062.334501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.334714:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923885952 00000100:00100000:1.0:1783951062.334726:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923885952 00000100:00100000:1.0:1783951062.334923:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:1.0:1783951062.334938:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+48:10801:x1870607923885952:12345-192.168.202.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783951062.335654:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:10801:x1870607923885952:12345-192.168.202.33@tcp:35:ldlm_bl.0 Request processed in 715us (1161us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1783951062.335971:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248303800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944921216:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951062.336007:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951062.336740:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:1.0:1783951062.339637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.339975:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923886080 00000100:00100000:0.0:1783951062.339988:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923886080 00010000:00010000:0.0:1783951062.340044:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 49 pid: 6526 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951062.340130:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 85 00000100:00100000:0.0:1783951062.340166:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:2407:x1870607923886080:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951062.340187:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951062.340196:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 49 pid: 6526 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.340211:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 49 pid: 6526 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.340248:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8b5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ca expref: 49 pid: 6526 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.340377:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951062.340399:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.340413:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.340422:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.340464:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951062.340541:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+48:2407:x1870607923886080:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 400us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951062.340550:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 85 00010000:00010000:1.0:1783951062.340616:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340625:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951062.340710:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783951062.340716:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951062.340747:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340761:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340772:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340796:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340803:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340810:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951062.340814:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340823:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340846:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951062.340849:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951062.340854:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340859:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8b84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340872:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340878:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340884:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340889:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951062.340907:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340914:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340923:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:1.0:1783951062.340925:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951062.340928:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340933:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8b8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340971:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8b7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d8 expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340987:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d8 expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.340994:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951062.340996:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951062.340999:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:1.0:1783951062.341032:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:12315:x1870607923885696:12345-192.168.202.33@tcp:101:stat.0 Request processed in 12302us (12632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951062.341040:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 171 00000100:00100000:2.0:1783951062.385634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.385781:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923886336 00000100:00100000:1.0:1783951062.385863:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923886336 00000100:00100000:1.0:1783951062.386017:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 172 00000100:00100000:1.0:1783951062.386027:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:12321:x1870607923886336:12345-192.168.202.33@tcp:36:truncate.0 00010000:00010000:1.0:1783951062.386106:0:10105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951062.386139:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8b92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d8 expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.386179:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951062.386183:0:10105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951062.386431:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.386445:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.386454:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951062.386494:0:10105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1783951062.386510:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fe4a1ce reply state 000000001b16002a transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.386520:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.386524:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951062.386526:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951062.386528:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951062.386627:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:12321:x1870607923886336:12345-192.168.202.33@tcp:36:truncate.0 Request processed in 601us (1006us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1783951062.386633:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 172 00000020:00080000:1.0:1783951062.386637:0:10105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783951062.504579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.504886:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923886464 00000100:00100000:1.0:1783951062.505396:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923886464 00000100:00100000:0.0:1783951062.505655:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 173 00000100:00100000:0.0:1783951062.505670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+49:12335:x1870607923886464:12345-192.168.202.33@tcp:101:stat.0 00010000:00010000:0.0:1783951062.505715:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951062.505751:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8ba0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7df expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.505859:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.505878:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.505893:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.505916:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.505938:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.505946:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506048:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506058:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506065:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951062.506121:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783951062.506126:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951062.506185:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506199:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506208:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506215:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506221:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506512:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5de00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951062.506517:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506524:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506538:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951062.506541:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951062.506546:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506553:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ba7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506570:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506577:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506583:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506588:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951062.506592:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506598:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506616:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:0.0:1783951062.506618:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951062.506621:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506628:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8bae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506667:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8ba0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 51 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506698:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.506707:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951062.506710:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951062.506713:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c000, rc 0) 00000100:00100000:0.0:1783951062.506916:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+50:12335:x1870607923886464:12345-192.168.202.33@tcp:101:stat.0 Request processed in 1248us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951062.506926:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 173 00000100:00100000:2.0:1783951062.595527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.598602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923886720 00000100:00100000:1.0:1783951062.598627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923886720 00000100:00100000:1.0:1783951062.599094:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 174 00000100:00100000:1.0:1783951062.599109:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+50:12345:x1870607923886720:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951062.599139:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951062.599191:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8bbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7e6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951062.599346:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783951062.599493:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8bbc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7e6 expref: 52 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.599511:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:1.0:1783951062.599514:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951062.599520:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8bbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7e6 expref: 52 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.599539:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030800, rc 0) 00000100:00100000:1.0:1783951062.599644:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02469db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+51:12345:x1870607923886720:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 538us (4131us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1783951062.607435:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 174 00000100:00100000:2.0:1783951062.607450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.607792:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923886976 00000100:00100000:0.0:1783951062.607806:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923886976 00000100:00100000:0.0:1783951062.607877:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:0.0:1783951062.607889:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+51:12345:x1870607923886976:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951062.609175:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:12345:x1870607923886976:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 1249us (1686us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1783951062.609189:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:2.0:1783951062.660038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.660200:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923887232 00000100:00100000:1.0:1783951062.660213:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923887232 00000100:00100000:1.0:1783951062.660291:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 175 00000100:00100000:1.0:1783951062.660305:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:12351:x1870607923887232:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951062.660340:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951062.660366:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8bca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7ed expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.660537:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.660556:0:10105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 53 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.660566:0:10105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.660612:0:10105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 53 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.660628:0:10105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 53 pid: 6527 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951062.660644:0:10105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944921344:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951062.660792:0:10105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951062.664369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.664517:0:10105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10105:1870607944921344:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951062.664555:0:10105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951062.668598:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923887360 00000100:00100000:3.0:1783951062.668620:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923887360 00010000:00010000:3.0:1783951062.668697:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 54 pid: 6527 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951062.668769:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 86 00000100:00100000:3.0:1783951062.668791:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:2407:x1870607923887360:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951062.668813:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951062.668821:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 54 pid: 6527 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.668848:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 54 pid: 6527 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.668877:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8bb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7df expref: 54 pid: 6527 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.669048:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951062.669056:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.669071:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.669080:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.669129:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951062.669277:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:2407:x1870607923887360:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 496us (4922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951062.669287:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 86 00010000:00010000:0.0:1783951062.669539:0:10105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.669549:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951062.669575:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1783951062.669773:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8bca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 54 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.669923:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 53 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.669933:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951062.669936:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783951062.669939:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031600, rc 0) 00000100:00100000:0.0:1783951062.669984:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:12351:x1870607923887232:12345-192.168.202.33@tcp:101:bash.0 Request processed in 9682us (9962us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783951062.669992:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 175 00000100:00100000:2.0:1783951062.678053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.682315:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923887616 00000100:00100000:0.0:1783951062.682336:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923887616 00000100:00100000:0.0:1783951062.682436:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 176 00000100:00100000:0.0:1783951062.682449:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+53:12351:x1870607923887616:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:0.0:1783951062.683032:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.683059:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.683073:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951062.683138:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1783951062.683195:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087c81780 reply state 00000000a84f05eb transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.683210:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.683217:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951062.683220:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951062.683224:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951062.683355:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12351:x1870607923887616:12345-192.168.202.33@tcp:36:bash.0 Request processed in 906us (5315us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1783951062.683364:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 176 00000020:00080000:0.0:1783951062.683369:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783951062.690489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.690583:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923887744 00000100:00100000:1.0:1783951062.690595:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923887744 00000100:00100000:1.0:1783951062.690674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 177 00000100:00100000:1.0:1783951062.690688:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12351:x1870607923887744:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951062.690720:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951062.690779:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8be6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7f4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.690938:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.690957:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 57 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.690968:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.691012:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 57 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.691027:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 57 pid: 10105 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951062.691043:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944921472:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951062.691171:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951062.694985:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944921472:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951062.695035:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951062.695127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951062.695448:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923887872 00000100:00100000:3.0:1783951062.695458:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923887872 00010000:00010000:3.0:1783951062.695516:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 58 pid: 10105 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951062.695560:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 87 00000100:00100000:3.0:1783951062.695571:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:2408:x1870607923887872:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951062.695590:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951062.695599:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 58 pid: 10105 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.695612:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 58 pid: 10105 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.695639:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8bd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ed expref: 58 pid: 10105 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.695659:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951062.695666:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.695902:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.695914:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951062.696006:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951062.696085:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:2408:x1870607923887872:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 514us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951062.696095:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 87 00010000:00010000:1.0:1783951062.698048:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.698068:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951062.698483:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783951062.698490:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951062.698523:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.698579:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8be6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7f4 expref: 57 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.698606:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7f4 expref: 56 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.698616:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951062.698619:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951062.698622:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951062.699089:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12351:x1870607923887744:12345-192.168.202.33@tcp:101:bash.0 Request processed in 8399us (8609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951062.699100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 177 00000100:00100000:0.0:1783951062.703628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.703781:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888128 00000100:00100000:1.0:1783951062.703793:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888128 00000100:00100000:1.0:1783951062.703964:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1783951062.703977:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12351:x1870607923888128:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:1.0:1783951062.704461:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:12351:x1870607923888128:12345-192.168.202.33@tcp:35:bash.0 Request processed in 484us (843us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1783951062.704470:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:2.0:1783951062.789912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.789966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.790012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.790046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.790098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.790130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.790214:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888768 00000100:00100000:2.0:1783951062.790227:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888768 00000100:00100000:2.0:1783951062.790294:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888384 00000100:00100000:2.0:1783951062.790297:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888384 00000100:00100000:2.0:1783951062.790326:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888896 00000100:00100000:2.0:1783951062.790329:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888896 00000100:00100000:2.0:1783951062.790354:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 314 00000100:00100000:2.0:1783951062.790364:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923888768:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951062.790446:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888512 00000100:00100000:0.0:1783951062.790451:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888512 00000100:00100000:2.0:1783951062.790462:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923888768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951062.790470:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 314 00000100:00100000:0.0:1783951062.790480:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888640 00000100:00100000:0.0:1783951062.790482:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888640 00000100:00100000:2.0:1783951062.790490:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 315 00000100:00100000:2.0:1783951062.790496:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923888384:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951062.790502:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:0.0:1783951062.790509:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923888512:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951062.790523:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923888384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951062.790534:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923888512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951062.790537:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 315 00000100:00100000:0.0:1783951062.790540:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:2.0:1783951062.790549:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 316 00000100:00100000:0.0:1783951062.790551:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:2.0:1783951062.790556:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923888896:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951062.790556:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923888640:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951062.790579:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923888896:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951062.790584:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2409:x1870607923888640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951062.790585:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 316 00000100:00100000:0.0:1783951062.790589:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00080000:0.0:1783951062.790607:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951062.790613:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951062.790733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923888256 00000100:00100000:3.0:1783951062.790738:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923888256 00000100:00100000:3.0:1783951062.790773:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 390 00000100:00100000:3.0:1783951062.790781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923888256:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951062.790810:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923888256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951062.790816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 390 00000100:00100000:2.0:1783951062.798441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.798587:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923889152 00000100:00100000:1.0:1783951062.798602:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923889152 00000100:00100000:1.0:1783951062.798800:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 178 00000100:00100000:1.0:1783951062.798813:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+57:12361:x1870607923889152:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951062.798923:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951062.798951:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8bf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f7fb expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951062.799098:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783951062.799517:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8bf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7fb expref: 59 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.799535:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:1.0:1783951062.799538:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951062.799544:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8bf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7fb expref: 59 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.799561:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67600, rc 0) 00000100:00100000:1.0:1783951062.799637:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12361:x1870607923889152:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 827us (1211us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1783951062.799645:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 178 00000100:00100000:2.0:1783951062.803781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.803926:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923889280 00000100:00100000:1.0:1783951062.803938:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923889280 00000100:00100000:1.0:1783951062.804016:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 179 00000100:00100000:1.0:1783951062.804030:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12361:x1870607923889280:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:1.0:1783951062.804134:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804208:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804242:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804265:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804273:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804280:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804390:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804401:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804409:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951062.804478:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804494:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804502:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804509:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804525:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951062.804531:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804538:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804552:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951062.804556:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951062.804561:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804567:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8c02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804585:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804591:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804596:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804601:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951062.804604:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804610:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804628:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:1.0:1783951062.804630:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951062.804633:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804639:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8c09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804650:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804655:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804660:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804665:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951062.804668:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804687:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804695:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951062.804697:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951062.804700:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.804706:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951062.804822:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12361:x1870607923889280:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 793us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951062.804842:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 179 00000100:00100000:2.0:1783951062.807587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.807653:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923889536 00000100:00100000:0.0:1783951062.807666:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923889536 00000100:00100000:0.0:1783951062.808028:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:0.0:1783951062.808041:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12361:x1870607923889536:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951062.808385:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:12361:x1870607923889536:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 345us (808us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1783951062.808394:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:3.0:1783951062.839579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.839806:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923889792 00000100:00100000:0.0:1783951062.839818:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923889792 00000100:00100000:0.0:1783951062.839918:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 180 00000100:00100000:0.0:1783951062.839930:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:12364:x1870607923889792:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951062.839966:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951062.839993:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f802 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840103:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840121:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840134:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840213:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840220:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840227:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840389:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840399:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840407:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951062.840418:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783951062.840537:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840544:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840551:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840557:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951062.840563:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840583:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840597:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951062.840600:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951062.840606:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840613:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840629:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840634:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840640:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840645:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951062.840648:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840653:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840660:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:0.0:1783951062.840663:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951062.840665:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840813:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840874:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f802 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840891:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f802 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951062.840899:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951062.840902:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951062.840905:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d400, rc 0) 00000100:00100000:0.0:1783951062.840994:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:12364:x1870607923889792:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1065us (1429us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1783951062.841003:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 180 00000100:00100000:2.0:1783951062.844716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951062.844779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951062.844883:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923889920 00000100:00100000:1.0:1783951062.844896:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923889920 00000100:00100000:1.0:1783951062.844976:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 181 00000100:00100000:1.0:1783951062.844989:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:12364:x1870607923889920:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:1.0:1783951062.845084:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845106:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845120:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845208:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845216:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845225:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845231:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951062.845236:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845244:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845289:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951062.845293:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951062.845299:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951062.845305:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8c3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951062.845403:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:12364:x1870607923889920:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 416us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951062.845412:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 181 00000100:00100000:3.0:1783951062.853792:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923890048 00000100:00100000:3.0:1783951062.853818:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923890048 00000100:00100000:2.0:1783951062.854091:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:2.0:1783951062.854105:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:2408:x1870607923890048:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951062.854126:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951062.854183:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f802 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951062.854206:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:2.0:1783951062.854212:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951062.854338:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:2408:x1870607923890048:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 236us (9569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951062.854345:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:1.0:1783951062.854467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951062.854649:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923890304 00000100:00100000:0.0:1783951062.854655:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923890304 00000100:00100000:0.0:1783951062.854700:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:0.0:1783951062.854710:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:12364:x1870607923890304:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951062.855006:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:12364:x1870607923890304:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 298us (540us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1783951062.855013:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:1.0:1783951063.003797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951063.003982:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923890560 00000100:00100000:2.0:1783951063.003994:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923890560 00000100:00100000:2.0:1783951063.004073:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 182 00000100:00100000:2.0:1783951063.004110:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+61:12382:x1870607923890560:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:2.0:1783951063.004186:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951063.004214:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8c41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f809 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951063.004472:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783951063.004496:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8c48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.004514:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.004526:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8c48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951063.004538:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783951063.004671:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f8c41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f809 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.004690:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8c48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f809 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.004698:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:2.0:1783951063.004701:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783951063.004703:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608e00, rc 0) 00000100:00100000:2.0:1783951063.004821:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12382:x1870607923890560:12345-192.168.202.33@tcp:101:cat.0 Request processed in 717us (1039us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783951063.004838:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 182 00000100:00100000:2.0:1783951063.026968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951063.027066:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923890688 00000100:00100000:0.0:1783951063.027079:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923890688 00000100:00100000:0.0:1783951063.027192:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 183 00000100:00100000:0.0:1783951063.027226:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12383:x1870607923890688:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951063.027260:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951063.027289:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f810 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.027394:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.027409:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.027419:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951063.027472:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783951063.027476:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951063.027495:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.027518:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f810 expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.027534:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f810 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.027541:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951063.027543:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951063.027545:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951063.027618:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12383:x1870607923890688:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 397us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951063.027630:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 183 00000100:00100000:1.0:1783951063.032739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951063.038986:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891072 00000100:00100000:2.0:1783951063.039036:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891072 00000100:00100000:2.0:1783951063.039198:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:2.0:1783951063.039213:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12383:x1870607923891072:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951063.039682:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12383:x1870607923891072:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 469us (6954us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1783951063.039692:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:3.0:1783951063.048599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951063.048761:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891200 00000100:00100000:1.0:1783951063.048774:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891200 00000100:00100000:1.0:1783951063.048872:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:1.0:1783951063.048885:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248303100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12383:x1870607923891200:12345-192.168.202.33@tcp:103:lfs.0 00010000:00010000:1.0:1783951063.048906:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783951063.048939:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8bed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7f4 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951063.048968:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8c48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f809 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951063.048986:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8aea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7ae expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951063.049022:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951063.049029:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951063.049113:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248303100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:12383:x1870607923891200:12345-192.168.202.33@tcp:103:lfs.0 Request processed in 231us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951063.049122:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:3.0:1783951063.053805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951063.054922:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891328 00000100:00100000:0.0:1783951063.054941:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891328 00000100:00100000:0.0:1783951063.055024:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 184 00000100:00100000:0.0:1783951063.055036:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:12383:x1870607923891328:12345-192.168.202.33@tcp:58:lfs.0 00010000:00010000:0.0:1783951063.059499:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.059535:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.059551:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951063.059716:0:10105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1783951063.059878:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:12383:x1870607923891328:12345-192.168.202.33@tcp:58:lfs.0 Request processed in 4837us (6081us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951063.059891:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 184 00000100:00100000:0.0:1783951063.100703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.104003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891456 00000100:00100000:3.0:1783951063.104028:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891456 00000100:00100000:3.0:1783951063.104304:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 185 00000100:00100000:3.0:1783951063.104317:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+62:12385:x1870607923891456:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951063.104695:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951063.104724:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8c6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f817 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.104814:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.104861:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.104876:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.104890:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.104898:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.104904:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.105004:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.105013:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.105021:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951063.105081:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783951063.105087:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951063.105110:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.105125:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106465:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106483:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106491:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106498:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951063.106503:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106511:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106530:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:3.0:1783951063.106534:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951063.106540:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106548:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8c72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106567:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106573:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106579:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106598:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951063.106601:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106607:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106615:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:3.0:1783951063.106618:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951063.106622:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106627:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8c79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106674:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8c6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106692:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.106699:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951063.106701:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951063.106704:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144000, rc 0) 00000100:00100000:3.0:1783951063.106813:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12385:x1870607923891456:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 2497us (6125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951063.106833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 185 00000100:00100000:2.0:1783951063.137120:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944921600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951063.137250:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951063.137610:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951063.141632:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944921600 00000100:00100000:3.0:1783951063.141675:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944921600 00000100:00100000:1.0:1783951063.154288:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783951063.154309:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944921600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951063.154378:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783951063.154495:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944921600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 191us (17245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951063.154504:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783951063.154833:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944921600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951063.648549:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944921728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951063.648657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951063.648774:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944921728 00000100:00100000:1.0:1783951063.648784:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944921728 00000100:00100000:1.0:1783951063.648864:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783951063.648876:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944921728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951063.648923:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783951063.648980:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944921728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951063.648988:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1783951063.649015:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951063.649063:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944921728:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1783951063.840600:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951063.840614:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951063.840649:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783951063.840661:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783951063.840853:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944921856:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783951063.841006:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951063.845347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951063.845464:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891584 00000100:00100000:2.0:1783951063.845477:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891584 00000100:00100000:2.0:1783951063.845562:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 186 00000100:00100000:2.0:1783951063.845576:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923891584:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951063.845621:0:11194:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951063.845785:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923891584:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951063.845795:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 186 00000100:00100000:1.0:1783951063.846304:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944921856:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783951063.855097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951063.855250:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891712 00000100:00100000:0.0:1783951063.855264:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891712 00000100:00100000:0.0:1783951063.855341:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 187 00000100:00100000:0.0:1783951063.855354:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12397:x1870607923891712:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783951063.855459:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.855505:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.855524:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857060:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857088:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857102:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857175:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857191:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857199:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951063.857263:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783951063.857267:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951063.857294:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857308:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857334:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857342:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857348:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951063.857354:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857360:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857373:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951063.857376:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951063.857380:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857386:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8c87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857402:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857408:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857413:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857418:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951063.857428:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857434:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857442:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9e024782e600) 00010000:00010000:0.0:1783951063.857444:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951063.857447:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857453:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8c8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857467:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857472:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857477:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857482:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951063.857485:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857498:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857505:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951063.857507:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951063.857517:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.857523:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8c95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951063.857623:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12397:x1870607923891712:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 2266us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951063.857633:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 187 00000100:00100000:0.0:1783951063.861038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.862247:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923891968 00000100:00100000:3.0:1783951063.862266:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923891968 00000100:00100000:3.0:1783951063.862361:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 188 00000100:00100000:3.0:1783951063.862383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12397:x1870607923891968:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951063.862414:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951063.862534:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f81e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862682:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862696:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862708:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951063.862719:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783951063.862812:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862829:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862835:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862842:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951063.862859:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862867:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862878:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951063.862881:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951063.862885:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862892:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ca3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862935:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c9c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f81e expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862946:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951063.862948:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951063.862952:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8c9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f81e expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.862962:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5de00, rc 0) 00000100:00100000:0.0:1783951063.863025:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923891968:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 647us (1998us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1783951063.863034:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 188 00000100:00100000:2.0:1783951063.865747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.866501:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923892096 00000100:00100000:3.0:1783951063.866517:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923892096 00000100:00100000:3.0:1783951063.866608:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 189 00000100:00100000:3.0:1783951063.866622:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923892096:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783951063.866670:0:6526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783951063.866852:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923892096:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 232us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951063.866862:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 189 00000100:00100000:1.0:1783951063.888730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.888956:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923892352 00000100:00100000:3.0:1783951063.888966:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923892352 00000100:00100000:3.0:1783951063.889071:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 190 00000100:00100000:3.0:1783951063.889089:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923892352:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951063.889111:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951063.889115:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783951063.889176:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8c5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f810 expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.889195:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:3.0:1783951063.889200:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951063.889213:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cb1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f825 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951063.890441:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1783951063.890631:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.890646:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.890656:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.891038:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f825 expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.891059:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f825 expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.891068:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e200) 00010000:00010000:3.0:1783951063.891071:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951063.891074:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145e00, rc 0) 00000100:00100000:3.0:1783951063.891190:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12397:x1870607923892352:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 2108us (2467us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1783951063.891200:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 190 00000100:00100000:1.0:1783951063.904989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951063.905079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923892608 00000100:00100000:2.0:1783951063.905093:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923892608 00000100:00100000:2.0:1783951063.905193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 191 00000100:00100000:2.0:1783951063.905208:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12397:x1870607923892608:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783951063.905292:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951063.905327:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f825 expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905350:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e200) 00010000:00010000:2.0:1783951063.905387:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951063.905418:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905434:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905445:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905461:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905468:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905475:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905548:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905556:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905563:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905570:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951063.905576:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905584:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905602:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951063.905604:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951063.905609:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905616:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8cc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905631:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905638:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905644:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905648:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951063.905651:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905659:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905666:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xae79585f (ffff9e0247828200) 00010000:00010000:2.0:1783951063.905668:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951063.905671:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951063.905677:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8ccd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae79585f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951063.905798:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923892608:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 594us (823us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951063.905806:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 191 00000100:00100000:2.0:1783951063.916804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.916945:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923892736 00000100:00100000:3.0:1783951063.916956:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923892736 00000100:00100000:3.0:1783951063.917018:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 192 00000100:00100000:3.0:1783951063.917029:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12397:x1870607923892736:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951063.917051:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951063.917087:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8cd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f82c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.917162:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.917176:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.917188:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.917316:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8cd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.917335:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.917343:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951063.917346:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951063.917350:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:3.0:1783951063.917848:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12397:x1870607923892736:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 819us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951063.917856:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 192 00000100:00100000:3.0:1783951063.931511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.931547:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923892992 00000100:00100000:3.0:1783951063.931557:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923892992 00000100:00100000:3.0:1783951063.931612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 193 00000100:00100000:3.0:1783951063.931622:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12397:x1870607923892992:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951063.931741:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.931758:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.931771:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951063.931962:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1783951063.931972:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419579829350ns, next at 420579827083ns, rc = 0 00000004:00010000:3.0:1783951063.932023:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd5f73e3 reply state 00000000d765f2af transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.932037:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.932044:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951063.932047:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783951063.932050:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951063.932166:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12397:x1870607923892992:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 544us (664us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1783951063.932174:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 193 00000100:00100000:3.0:1783951063.937265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951063.937520:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923893120 00000100:00100000:0.0:1783951063.937530:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923893120 00000100:00100000:0.0:1783951063.937586:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 194 00000100:00100000:0.0:1783951063.937597:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12397:x1870607923893120:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951063.937633:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951063.937655:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f833 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.939548:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 68 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.939568:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 68 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951063.939591:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:0.0:1783951063.939595:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951063.939599:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2c00, rc 0) 00000100:00100000:0.0:1783951063.940520:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:12397:x1870607923893120:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 2918us (3260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951063.940533:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 194 00000100:00100000:2.0:1783951063.958387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951063.958551:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923893248 00000100:00100000:0.0:1783951063.958564:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923893248 00000100:00100000:0.0:1783951063.959940:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1783951063.959957:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923893248:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783951063.960220:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923893248:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 267us (1842us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783951063.960229:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1783951063.972996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.973076:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923893504 00000100:00100000:3.0:1783951063.973086:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923893504 00000100:00100000:3.0:1783951063.973162:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:3.0:1783951063.973172:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:12397:x1870607923893504:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783951063.973519:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+69:12397:x1870607923893504:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 348us (532us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1783951063.973537:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:3.0:1783951063.978729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951063.978965:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923893760 00000100:00100000:0.0:1783951063.978974:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923893760 00000100:00100000:0.0:1783951063.979045:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 195 00000100:00100000:0.0:1783951063.979054:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+69:12397:x1870607923893760:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783951063.979193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+69:12397:x1870607923893760:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 140us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951063.979201:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 195 00000100:00100000:1.0:1783951063.984773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.984941:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923893888 00000100:00100000:3.0:1783951063.984951:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923893888 00000100:00100000:3.0:1783951063.985003:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 196 00000100:00100000:3.0:1783951063.985012:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+69:12397:x1870607923893888:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951063.985032:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951063.985051:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f83a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.985116:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8cf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.985131:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.985170:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951063.985218:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951063.985235:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.985259:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8cf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f83a expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.985276:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f83a expref: 70 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.985734:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951063.985737:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783951063.985741:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031c00, rc 0) 00000100:00100000:3.0:1783951063.986276:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+70:12397:x1870607923893888:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1262us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951063.986953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 196 00000100:00100000:1.0:1783951063.993748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951063.993971:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894016 00000100:00100000:3.0:1783951063.993983:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894016 00000100:00100000:3.0:1783951063.994097:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:3.0:1783951063.994110:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923894016:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951063.994133:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951063.994174:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f841 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951063.994204:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54eed7, blocks: 0x0 00010000:00010000:3.0:1783951063.994225:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1783951063.994230:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951063.994241:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.994262:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951063.994276:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030800, rc 0) 00000100:00100000:3.0:1783951063.994359:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923894016:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 252us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951063.994366:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:2.0:1783951064.000116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951064.000201:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894272 00000100:00100000:0.0:1783951064.000211:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894272 00000100:00100000:0.0:1783951064.000272:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 197 00000100:00100000:0.0:1783951064.000296:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+70:12397:x1870607923894272:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783951064.000421:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+70:12397:x1870607923894272:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951064.000429:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 197 00000100:00100000:3.0:1783951064.007366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951064.007426:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894400 00000100:00100000:2.0:1783951064.007436:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894400 00000100:00080000:0.0:1783951064.007462:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951064.007496:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:2.0:1783951064.007509:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:12397:x1870607923894400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951064.007528:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951064.007547:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f848 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.007582:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.007591:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951064.007596:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951064.007601:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.007634:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.007656:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 9 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951064.007671:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944921984:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951064.007758:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e4133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951064.011216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951064.011269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894528 00000100:00100000:3.0:1783951064.011285:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894528 00010000:00010000:3.0:1783951064.011332:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 10 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.011376:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:3.0:1783951064.011386:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034a66b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2408:x1870607923894528:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951064.011402:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951064.011425:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 10 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.011440:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 10 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.011465:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951064.011470:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951064.011478:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.011488:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.011553:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.011566:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1870607944922112:192.168.202.33@tcp:105: 00000100:00100000:3.0:1783951064.011644:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118cf00 going to sleep for 11 seconds 00010000:00010000:0.0:1783951064.011789:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f8cfe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f841 expref: 10 pid: 8441 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951064.011804:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944921984:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951064.011840:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.011850:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609800, rc 0) 00000100:00100000:0.0:1783951064.011879:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:12397:x1870607923894400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 4374us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951064.011887:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:1.0:1783951064.014830:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1870607944922112:192.168.202.33@tcp:105: 00010000:00010000:1.0:1783951064.014860:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951064.014921:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034a66b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923894528:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 3536us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951064.014932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:0.0:1783951064.031895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951064.032060:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894656 00000100:00100000:1.0:1783951064.032070:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894656 00002000:00100000:1.0:1783951064.032118:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9e0248336300 x1870607923894656/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:80/0 lens 504/0 e 0 to 0 dl 1783951075 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951064.032130:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0248336300 with x1870607923894656 ext(0->8) 00002000:00010000:1.0:1783951064.032136:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0248336300 00000100:00100000:1.0:1783951064.034848:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:1.0:1783951064.034866:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923894656:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783951064.036351:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2408:x1870607923894656:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 Request processed in 1481us (4567us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783951064.036364:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00002000:00100000:1.0:1783951064.036376:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9e0248336300 x1870607923894656/t4294967315(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:80/0 lens 504/448 e 0 to 0 dl 1783951075 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951064.036386:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0248336300 with x1870607923894656 ext(0->8) 00002000:00010000:1.0:1783951064.036393:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0248336300 00000100:00100000:1.0:1783951064.051478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951064.051969:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894784 00000100:00100000:0.0:1783951064.051980:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894784 00000100:00100000:0.0:1783951064.052079:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 198 00000100:00100000:0.0:1783951064.052090:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+70:12397:x1870607923894784:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783951064.057296:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1783951064.057314:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1783951064.057371:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783951064.057388:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e0348898180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783951064.057393:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0381062a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e0348898780 00000020:00080000:2.0:1783951064.057396:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0381062900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e02479f4000 00000020:00080000:2.0:1783951064.057561:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783951064.057614:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783951064.057634:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944922368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951064.057699:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951064.057752:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951064.057759:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944922240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783951064.057798:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951064.058022:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058033:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058040:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058047:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058052:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058060:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058077:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e0247828700) 00010000:00010000:1.0:1783951064.058080:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951064.058085:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058107:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8a2d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058130:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058137:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058172:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058177:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058180:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058186:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058194:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951064.058197:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951064.058199:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058205:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8a34 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058218:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058225:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058238:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058243:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058246:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058252:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058260:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e400) 00010000:00010000:1.0:1783951064.058262:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951064.058265:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058271:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8a73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058302:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058308:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058313:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058317:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058319:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058334:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058342:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951064.058344:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951064.058347:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058352:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8b76 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058364:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058369:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058374:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058379:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058382:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058388:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058395:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951064.058397:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951064.058399:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058412:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8b99 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058423:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058429:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058434:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058438:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058441:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058446:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058454:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:1.0:1783951064.058456:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951064.058459:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058464:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c200/0x7645c8e1169f8bdf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058472:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058478:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058489:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058494:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951064.058496:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058501:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058509:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:1.0:1783951064.058511:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783951064.058514:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.058519:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8ce2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951064.059013:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944922368 00000100:00100000:2.0:1783951064.059022:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944922368 00000100:00100000:2.0:1783951064.059089:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944922240 00000100:00100000:2.0:1783951064.059093:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944922240 00000100:00100000:2.0:1783951064.059122:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951064.059132:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944922368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783951064.059196:0:9851:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1783951064.059231:0:9851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a54eed5, atime: 0x6a54eed5, ctime: 0x6a54eed5, blocks: 0x8 00010000:00010000:2.0:1783951064.059239:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059253:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1783951064.059258:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951064.059264:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059289:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059299:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059306:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059326:0:9851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783951064.059505:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944922368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 373us (1804us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783951064.059513:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951064.059532:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951064.059540:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944922240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783951064.059631:0:9851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783951064.059640:0:9851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783951063 00002000:00010000:2.0:1783951064.059642:0:9851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783951064.059644:0:9851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783951063 -> 1783951063 00002000:00010000:2.0:1783951064.059646:0:9851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783951064.059674:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944922240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (1875us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783951064.059680:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1783951064.059708:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951064.059714:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059721:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951064.059725:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059733:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059746:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059753:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e45d53e/0x7645c8e1169f8d0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.059767:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951064.059769:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951064.059771:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951064.059965:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12397:x1870607923894784:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 7875us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951064.059981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 198 00000004:00080000:2.0:1783951064.060123:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0248397b80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1783951064.060131:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944922240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1783951064.060166:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0248397480/2, rc 0, transno 4294967308 00000100:00100000:2.0:1783951064.060172:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944922368:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1783951064.060436:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951064.060442:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951064.063341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951064.063378:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923894912 00000100:00100000:2.0:1783951064.063388:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923894912 00000100:00100000:2.0:1783951064.063439:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:2.0:1783951064.063449:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2409:x1870607923894912:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783951064.065519:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1783951064.065534:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1783951064.065695:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923894912:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 2242us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951064.065707:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:2.0:1783951064.071962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951064.072099:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923895168 00000100:00100000:3.0:1783951064.072110:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923895168 00000100:00100000:3.0:1783951064.072193:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 199 00000100:00100000:3.0:1783951064.072204:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12397:x1870607923895168:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951064.072275:0:10105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951064.072420:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8cf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f83a expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.072441:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951064.072446:0:10105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951064.072478:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.072492:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.072501:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951064.072637:0:10105:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000435d5baa reply state 0000000045059e06 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.072658:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.072664:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951064.072667:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951064.072669:0:10105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951064.072824:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:12397:x1870607923895168:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 612us (862us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1783951064.072833:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 199 00000100:00100000:0.0:1783951064.085580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951064.086547:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923895296 00000100:00100000:3.0:1783951064.086560:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923895296 00000100:00100000:3.0:1783951064.086627:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:3.0:1783951064.086637:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923895296:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783951064.086980:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783951064.086984:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1783951063 -> 1783951062 00002000:00010000:3.0:1783951064.086987:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783951061 00002000:00010000:3.0:1783951064.086989:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783951063 -> 1783951062 00002000:00010000:3.0:1783951064.086991:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783951064.087091:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923895296:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 454us (1520us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1783951064.087101:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:2.0:1783951064.098265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951064.098406:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923895552 00000100:00100000:0.0:1783951064.098417:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923895552 00000100:00100000:0.0:1783951064.098478:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 200 00000100:00100000:0.0:1783951064.098488:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:12397:x1870607923895552:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783951064.098559:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.098577:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.098587:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.098621:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.098635:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 20 pid: 6526 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951064.098650:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944922496:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951064.098753:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0343881540 going to sleep for 11 seconds 00000100:00100000:2.0:1783951064.113927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951064.114110:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944922496:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951064.114160:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951064.118689:0:14662:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951064.118699:0:14662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951064.118735:0:14662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783951064.118743:0:14662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951064.121236:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923895680 00000100:00100000:2.0:1783951064.121251:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923895680 00010000:00010000:2.0:1783951064.121297:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 21 pid: 6526 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951064.121344:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:2.0:1783951064.121356:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:2407:x1870607923895680:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951064.121372:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951064.121387:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 21 pid: 6526 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.121402:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 21 pid: 6526 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.121425:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8cdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f82c expref: 21 pid: 6526 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.121444:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:2.0:1783951064.121450:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.121461:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.121470:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.121498:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951064.121556:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:2407:x1870607923895680:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 202us (7639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951064.121564:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 89 00010000:00010000:0.0:1783951064.122169:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122178:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122222:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122229:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122235:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122241:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951064.122246:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122252:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122263:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:0.0:1783951064.122266:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783951064.122270:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.122276:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951064.122345:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12397:x1870607923895552:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 Request processed in 23857us (24088us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783951064.122354:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 200 00000100:00100000:1.0:1783951064.137828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951064.137904:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923895808 00000100:00100000:2.0:1783951064.137915:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923895808 00000100:00100000:2.0:1783951064.137980:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:2.0:1783951064.137992:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2407:x1870607923895808:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783951064.138044:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.138086:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.138096:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951064.138100:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951064.138105:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.138171:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.138186:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 8 pid: 8439 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951064.138202:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1870607944922624:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951064.138285:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347f0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951064.147811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951064.147861:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923895936 00000100:00100000:2.0:1783951064.147870:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923895936 00010000:00010000:2.0:1783951064.147910:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 9 pid: 8439 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951064.147949:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 90 00000100:00100000:2.0:1783951064.147960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923895936:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951064.147975:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951064.148009:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 9 pid: 8439 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.148025:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 9 pid: 8439 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.148050:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951064.148054:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951064.148061:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.148071:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.148093:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951064.148167:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923895936:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 207us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951064.148175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 90 00010000:00010000:3.0:1783951064.150636:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f8d05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f848 expref: 8 pid: 8439 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.150668:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1870607944922624:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951064.150709:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150720:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150729:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150759:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150769:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150789:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150798:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951064.150803:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.150812:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.151018:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.151033:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f8d21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.151136:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923895808:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 13146us (13330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951064.151168:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:3.0:1783951064.157438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951064.157596:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923896192 00000100:00100000:1.0:1783951064.157606:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923896192 00000100:00100000:1.0:1783951064.157682:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 201 00000100:00100000:1.0:1783951064.157693:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12397:x1870607923896192:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783951064.157804:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.158787:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.158801:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.158982:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.158999:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 19 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951064.159016:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944922752:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951064.159111:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951064.160556:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944922880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951064.160600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951064.160634:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944922880 00000100:00100000:1.0:1783951064.160639:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944922880 00000100:00100000:1.0:1783951064.160682:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783951064.160688:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944922880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951064.160706:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783951064.160736:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944922880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951064.160742:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:1.0:1783951064.160830:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951064.160871:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944922880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951064.168867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951064.168959:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923896320 00000100:00100000:0.0:1783951064.168977:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923896320 00010000:00010000:0.0:1783951064.169021:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 20 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951064.169068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 91 00000100:00100000:0.0:1783951064.169078:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:2408:x1870607923896320:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951064.169094:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951064.169100:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 20 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.169114:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 20 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.169166:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:0.0:1783951064.169173:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.169184:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.169191:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951064.169210:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951064.169473:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:2408:x1870607923896320:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 395us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951064.169481:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 91 00010000:00010000:3.0:1783951064.170834:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8b6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f7d1 expref: 19 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.170857:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944922752:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951064.170881:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.170891:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.170897:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.171375:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.171389:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 19 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.171397:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.171437:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 19 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.171451:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 19 pid: 10105 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.171464:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944923008:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951064.171529:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0345c056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951064.184357:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944923008:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951064.184388:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951064.184587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951064.185118:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923896448 00000100:00100000:1.0:1783951064.185125:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923896448 00010000:00010000:1.0:1783951064.185190:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 20 pid: 10105 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951064.185240:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 92 00000100:00100000:1.0:1783951064.185250:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:2407:x1870607923896448:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951064.185265:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951064.185272:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 20 pid: 10105 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.185285:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 20 pid: 10105 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.185306:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2c00/0x7645c8e1169f8ce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f833 expref: 20 pid: 10105 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.185321:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:1.0:1783951064.185326:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.185349:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.185357:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951064.185386:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951064.185427:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.185437:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951064.185437:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:2407:x1870607923896448:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 188us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951064.185445:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 92 00000001:00080000:3.0:1783951064.185558:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1783951064.185971:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1783951064.186017:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1783951064.186184:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1870607944923136:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783951064.186237:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951064.186430:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432dd900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951064.186445:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944923136 00000100:00100000:0.0:1783951064.186450:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944923136 00000100:00100000:0.0:1783951064.186489:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783951064.186495:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1870607944923136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783951064.186560:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1870607944923136:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951064.186567:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783951064.186589:0:6527:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1783951064.186596:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0248397b80, transno 4294967316 00000100:00100000:3.0:1783951064.186610:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1870607944923136:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783951064.186804:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1783951064.186929:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1870607944923264:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783951064.186957:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951064.187027:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432dd480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951064.187065:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944923264 00000100:00100000:1.0:1783951064.187070:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944923264 00000100:00100000:1.0:1783951064.187221:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783951064.187229:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1870607944923264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783951064.187537:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6527:x1870607944923264:12345-0@lo:1000:mdt00_002.0 Request processed in 307us (578us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783951064.187544:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783951064.187616:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1870607944923264:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783951064.187655:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187902:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187910:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187916:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951064.187921:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187929:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187945:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951064.187948:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951064.187952:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187959:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187985:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.187991:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.189614:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.189628:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951064.189632:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.189640:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.189655:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951064.190024:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951064.190033:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.190041:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f8c64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.190071:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.190190:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.190199:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.190274:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951064.190302:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 22 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951064.190317:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944923392:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951064.190399:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347f0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951064.194345:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944923392:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951064.194379:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951064.195588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951064.195656:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923896576 00000100:00100000:3.0:1783951064.195669:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923896576 00010000:00010000:3.0:1783951064.195713:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 23 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.195756:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 93 00000100:00100000:3.0:1783951064.195764:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:2408:x1870607923896576:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951064.195778:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951064.195785:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 23 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195796:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 23 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195831:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8c80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f817 expref: 23 pid: 6524 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195846:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951064.195851:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195860:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195867:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195887:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951064.195930:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:2408:x1870607923896576:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 167us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951064.195936:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 93 00010000:00010000:3.0:1783951064.195965:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195973:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195985:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195991:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.195997:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196003:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951064.196007:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196014:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196023:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951064.196026:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951064.196030:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196036:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d36 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196046:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196062:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196068:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196072:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951064.196075:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196081:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196089:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0246937300) 00010000:00010000:3.0:1783951064.196091:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951064.196094:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.196100:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8d28 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951064.196256:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12397:x1870607923896192:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 38564us (38827us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783951064.196264:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 201 00000020:00080000:3.0:1783951064.196267:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783951064.196422:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951064.196427:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951064.197674:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1783951064.197686:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951064.203714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951064.203807:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923896832 00000100:00100000:3.0:1783951064.203825:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923896832 00000100:00100000:3.0:1783951064.203886:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:3.0:1783951064.203897:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12397:x1870607923896832:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783951064.204230:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783951064.204264:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1783951064.204299:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204315:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204327:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204335:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204342:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204349:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204369:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951064.204453:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:12397:x1870607923896832:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 557us (749us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1783951064.204463:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 50 00000020:00080000:3.0:1783951064.204468:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783951064.204520:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951064.204526:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204534:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951064.204538:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204559:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:3.0:1783951064.204574:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783951064.204578:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204584:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d3d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951064.204596:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951064.204598:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951064.204599:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951065.184674:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951065.185367:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783951065.248383:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951065.248392:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951065.248510:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783951065.248518:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783951066.208270:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951066.213889:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944923520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951066.215872:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944923648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951066.215942:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.216053:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944923648 00000100:00100000:2.0:1783951066.216060:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944923648 00000100:00100000:2.0:1783951066.216107:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783951066.216118:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944923648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951066.216178:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783951066.216228:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944923648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951066.216237:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783951066.216286:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944923648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951066.216714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.216758:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944924032:0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.216790:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.216898:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944924544:0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.216922:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.216938:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944925056:0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.216970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.216988:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783951066.216994:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944923904:0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.217015:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.217032:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944924416:0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.217051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.217067:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944924928:0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.217087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951066.217117:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944923520 00000100:00100000:1.0:1783951066.217121:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944923520 00000100:00100000:1.0:1783951066.217193:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951066.217201:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944923520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951066.217226:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783951066.217264:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944923520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.217271:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951066.217290:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924032 00000100:00100000:1.0:1783951066.217295:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924032 00000100:00100000:1.0:1783951066.217319:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944923904 00000100:00100000:1.0:1783951066.217322:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944923904 00000100:00100000:1.0:1783951066.217335:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924416 00000100:00100000:1.0:1783951066.217337:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924416 00000100:00100000:1.0:1783951066.217350:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1783951066.217356:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944924032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.217387:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944924032:12345-0@lo:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.217394:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1783951066.217413:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924928 00000100:00100000:1.0:1783951066.217416:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924928 00000100:00100000:1.0:1783951066.217434:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1783951066.217439:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944923904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.217469:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944923904:12345-0@lo:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.217476:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1783951066.217488:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783951066.217495:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944924416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.217520:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944924416:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.217526:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783951066.217537:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00080000:0.0:1783951066.218834:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951066.218842:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951066.218868:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924544 00000100:00100000:0.0:1783951066.218875:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924544 00000100:00100000:0.0:1783951066.218922:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944925056 00000100:00100000:0.0:1783951066.218926:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944925056 00000100:00100000:0.0:1783951066.218946:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783951066.218953:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944924544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.219025:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944924544:12345-0@lo:400:kworker.0 Request processed in 72us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.219033:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783951066.219048:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783951066.219053:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944925056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.219080:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944925056:12345-0@lo:400:kworker.0 Request processed in 28us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.219086:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1783951066.219103:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951066.219721:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944924928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951066.219767:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944924928:12345-0@lo:400:kworker.0 Request processed in 2225us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.219775:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1783951066.220298:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944923776:0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220348:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.220391:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944924288:0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220418:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.220439:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944924800:0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220462:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.220484:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783951066.220491:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944924160:0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220519:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.220561:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944924672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220587:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.220603:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944925184:0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220653:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951066.220723:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924160 00000100:00100000:2.0:1783951066.220735:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924160 00000100:00100000:2.0:1783951066.220774:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783951066.220781:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944924160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951066.220836:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944924160:12345-0@lo:400:kworker.0 Request processed in 55us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951066.220843:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783951066.220878:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944924160:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.221884:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924288 00000100:00100000:0.0:1783951066.221891:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924288 00000100:00100000:0.0:1783951066.221933:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924800 00000100:00100000:0.0:1783951066.221936:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924800 00000100:00100000:0.0:1783951066.221959:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783951066.221967:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944924288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222032:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944924288:12345-0@lo:400:kworker.0 Request processed in 66us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.222038:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783951066.222052:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783951066.222058:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02476cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944924800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222084:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02476cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944924800:12345-0@lo:400:kworker.0 Request processed in 27us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.222090:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783951066.222108:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944923776 00000100:00100000:0.0:1783951066.222111:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944923776 00000100:00100000:0.0:1783951066.222138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1783951066.222163:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944923776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222205:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944923776:12345-0@lo:400:kworker.0 Request processed in 42us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.222212:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1783951066.222247:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944924672 00000100:00100000:0.0:1783951066.222251:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944924672 00000100:00100000:0.0:1783951066.222277:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944925184 00000100:00100000:0.0:1783951066.222280:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944925184 00000100:00100000:0.0:1783951066.222298:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783951066.222304:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944924672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222334:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1870607944924672:12345-0@lo:400:kworker.0 Request processed in 30us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.222339:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783951066.222349:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783951066.222355:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944925184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222379:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944925184:12345-0@lo:400:kworker.0 Request processed in 25us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.222384:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1783951066.222404:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951066.222408:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951066.222411:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951066.222436:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944925312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951066.222470:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951066.222507:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944924672:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222518:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944925184:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222526:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944923776:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222672:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944924288:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222687:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944924800:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.222720:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944925312 00000100:00100000:0.0:1783951066.222724:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944925312 00000100:00100000:0.0:1783951066.222742:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783951066.222748:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037eb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944925312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951066.222762:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783951066.222820:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037eb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944925312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.222827:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783951066.223046:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944925312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951066.223081:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944923904:0@lo:400:kworker.0 00010000:00080000:0.0:1783951066.223095:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024856ea00 x1870607944924416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951066.223104:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944924416:0@lo:400:kworker.0 00010000:00080000:0.0:1783951066.223116:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024856dc00 x1870607944924928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951066.223124:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944924928:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.223135:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944924032:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.223165:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944924544:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.223177:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944925056:0@lo:400:kworker.0 00000100:00100000:0.0:1783951066.223204:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944923520:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1783951066.226413:0:14714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951066.226422:0:14714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951066.226448:0:14714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783951066.226456:0:14714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951066.408224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951066.408542:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923897088 00000100:00100000:3.0:1783951066.408552:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923897088 00000100:00100000:3.0:1783951066.408625:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 202 00000100:00100000:3.0:1783951066.408637:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:12416:x1870607923897088:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951066.408662:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951066.408683:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f84f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.408791:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.408816:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.408830:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951066.408854:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783951066.408954:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f84f expref: 26 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.408970:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f84f expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.408979:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:3.0:1783951066.408982:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783951066.408985:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340031c00, rc 0) 00000100:00100000:3.0:1783951066.409036:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:12416:x1870607923897088:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 402us (821us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783951066.409044:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 202 00000100:00080000:0.0:1783951066.409100:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951066.420248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.420352:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923897216 00000100:00100000:2.0:1783951066.420362:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923897216 00000100:00100000:2.0:1783951066.420422:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 203 00000100:00100000:2.0:1783951066.420433:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:12416:x1870607923897216:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:2.0:1783951066.420510:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420526:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420538:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420553:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420561:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420567:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420648:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420663:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420671:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951066.420721:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420734:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420741:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420748:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420753:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951066.420757:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420764:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420777:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951066.420780:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951066.420784:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420791:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8d59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420823:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420830:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420836:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420841:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951066.420844:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420849:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420857:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e0247828200) 00010000:00010000:2.0:1783951066.420859:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951066.420862:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420868:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8d60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420880:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420886:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420893:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420903:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951066.420907:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420913:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420921:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0247828f00) 00010000:00010000:2.0:1783951066.420923:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951066.420926:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.420931:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8d67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951066.421009:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:12416:x1870607923897216:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 577us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951066.421018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 203 00000100:00100000:3.0:1783951066.490855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.490928:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923897472 00000100:00100000:1.0:1783951066.490937:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923897472 00000100:00100000:1.0:1783951066.491000:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 204 00000100:00100000:1.0:1783951066.491010:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+25:12419:x1870607923897472:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951066.491031:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951066.491054:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f856 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491130:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491199:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491212:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491229:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491237:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491244:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491480:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491489:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491496:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951066.491506:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783951066.491613:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491622:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491629:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491642:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.491648:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491656:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491669:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951066.491673:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.491679:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491685:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8d75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491697:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491703:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491710:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491716:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.491719:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491726:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491747:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e0347f05b00) 00010000:00010000:1.0:1783951066.491750:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.491753:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491760:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8d7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491808:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 28 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491823:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 27 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.491831:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951066.491833:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951066.491836:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951066.491905:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12419:x1870607923897472:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 897us (1059us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1783951066.491913:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 204 00000100:00100000:2.0:1783951066.502273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.502601:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923897600 00000100:00100000:1.0:1783951066.502611:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923897600 00000100:00100000:1.0:1783951066.502950:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 205 00000100:00100000:1.0:1783951066.502962:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12419:x1870607923897600:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:1.0:1783951066.503035:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503053:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503080:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503122:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503130:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503138:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503176:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.503180:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503188:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503200:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951066.503203:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951066.503207:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.503214:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8d91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951066.503284:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12419:x1870607923897600:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 324us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.503293:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 205 00000100:00100000:3.0:1783951066.507073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.507456:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923897856 00000100:00100000:2.0:1783951066.507466:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923897856 00000100:00100000:2.0:1783951066.507629:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:2.0:1783951066.507642:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12419:x1870607923897856:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951066.507894:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+28:12419:x1870607923897856:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 255us (829us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1783951066.507903:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:3.0:1783951066.552458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951066.552659:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923898112 00000100:00100000:0.0:1783951066.552668:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923898112 00000100:00100000:0.0:1783951066.552736:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 206 00000100:00100000:0.0:1783951066.552747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+28:11942:x1870607923898112:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951066.552772:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951066.552807:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8d98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f85d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.552919:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.552934:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 29 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.552942:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.552976:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 29 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.553012:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 29 pid: 10105 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951066.553025:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944925440:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951066.554520:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0343881300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951066.557575:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1870607944925440:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951066.557623:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951066.558403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.558492:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923898240 00000100:00100000:1.0:1783951066.558499:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923898240 00010000:00010000:1.0:1783951066.558535:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 30 pid: 10105 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951066.558578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 94 00000100:00100000:1.0:1783951066.558588:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:2407:x1870607923898240:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951066.558604:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951066.558610:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 30 pid: 10105 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.558622:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 30 pid: 10105 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.558650:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8d83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f856 expref: 30 pid: 10105 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.558665:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951066.558669:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.558677:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.558685:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.558720:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951066.558776:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.558787:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951066.558788:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:2407:x1870607923898240:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 199us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.558818:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 94 00000004:00200000:2.0:1783951066.558822:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783951066.558985:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8d98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.559004:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.559013:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:2.0:1783951066.559016:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951066.559018:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3a00, rc 0) 00000100:00100000:2.0:1783951066.559047:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:11942:x1870607923898112:12345-192.168.202.33@tcp:101:bash.0 Request processed in 6303us (6599us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1783951066.559068:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 206 00000100:00100000:0.0:1783951066.563179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.563428:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923898368 00000100:00100000:1.0:1783951066.563438:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923898368 00000100:00100000:1.0:1783951066.563488:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 207 00000100:00100000:1.0:1783951066.563498:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:11942:x1870607923898368:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951066.563524:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951066.563544:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f864 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.563577:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8db4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.563590:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.563601:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.563746:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f864 expref: 31 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.563765:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f864 expref: 30 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.563774:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951066.563777:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951066.563780:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951066.564205:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11942:x1870607923898368:12345-192.168.202.33@tcp:101:bash.0 Request processed in 707us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.564221:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 207 00000100:00100000:3.0:1783951066.568097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.568272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923898624 00000100:00100000:2.0:1783951066.568289:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923898624 00000100:00100000:2.0:1783951066.568515:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 208 00000100:00100000:2.0:1783951066.568526:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:11942:x1870607923898624:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:2.0:1783951066.568755:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.568787:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.568810:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951066.568857:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1783951066.568885:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000557e050e reply state 0000000078bb53d9 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.568908:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.568916:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:2.0:1783951066.568919:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951066.568922:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783951066.568995:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1783951066.569845:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:11942:x1870607923898624:12345-192.168.202.33@tcp:36:bash.0 Request processed in 1318us (1753us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1783951066.569854:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 208 00000020:00080000:2.0:1783951066.569859:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783951066.574503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.574825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923898752 00000100:00100000:2.0:1783951066.574836:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923898752 00000100:00100000:2.0:1783951066.574913:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 209 00000100:00100000:2.0:1783951066.574924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+34:11942:x1870607923898752:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951066.574951:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951066.574974:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8dc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f86b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.575070:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f86b expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.575087:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f86b expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.575109:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:2.0:1783951066.575113:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951066.575117:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608c00, rc 0) 00000100:00100000:2.0:1783951066.575192:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:11942:x1870607923898752:12345-192.168.202.33@tcp:101:bash.0 Request processed in 269us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951066.575201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 209 00000100:00100000:3.0:1783951066.578135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951066.578386:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923898880 00000100:00100000:0.0:1783951066.578396:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923898880 00000100:00100000:0.0:1783951066.578521:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:0.0:1783951066.578533:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:11942:x1870607923898880:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951066.578552:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951066.578574:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f872 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951066.578602:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a54eed6, atime: 0x6a54eed5, ctime: 0x6a54eed6, blocks: 0x8 00010000:00010000:0.0:1783951066.578624:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1783951066.578628:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951066.578649:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.578668:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.578681:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2c00, rc 0) 00000100:00100000:0.0:1783951066.578766:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:11942:x1870607923898880:12345-192.168.202.33@tcp:101:bash.0 Request processed in 235us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.578773:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00080000:2.0:1783951066.579040:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951066.582016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.582438:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923899008 00000100:00100000:2.0:1783951066.582448:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923899008 00002000:00010000:2.0:1783951066.582490:0:8446:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1783951066.582496:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024860ad80 with x1870607923899008 ext(0->18446744073709551615) 00002000:00010000:2.0:1783951066.582508:0:8446:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e024860ad80. 00000100:00100000:2.0:1783951066.582576:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:2.0:1783951066.582587:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2410:x1870607923899008:12345-192.168.202.33@tcp:10:bash.0 00002000:00010000:2.0:1783951066.583001:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783951066.583006:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1783951062 -> 1783951066 00002000:00010000:2.0:1783951066.583008:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1783951061 -> 1783951061 00002000:00010000:2.0:1783951066.583010:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783951062 -> 1783951066 00002000:00010000:2.0:1783951066.583013:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1783951066.583094:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2410:x1870607923899008:12345-192.168.202.33@tcp:10:bash.0 Request processed in 507us (1085us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783951066.583102:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00002000:00010000:2.0:1783951066.583106:0:8446:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1783951066.583109:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024860ad80 with x1870607923899008 ext(0->18446744073709551615) 00002000:00010000:2.0:1783951066.583115:0:8446:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e024860ad80. 00000100:00100000:3.0:1783951066.657897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.657984:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923899136 00000100:00100000:1.0:1783951066.657993:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923899136 00000100:00100000:1.0:1783951066.658109:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 210 00000100:00100000:1.0:1783951066.658121:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:12433:x1870607923899136:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:1.0:1783951066.658240:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658267:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658279:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658295:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658303:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658309:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658385:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658394:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658400:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951066.658468:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658480:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658487:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658493:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658499:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.658503:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658510:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658523:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951066.658526:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.658531:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658537:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8dd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658550:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658557:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658570:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658576:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.658579:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658586:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658594:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e0347f05b00) 00010000:00010000:1.0:1783951066.658596:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.658599:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658605:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8dd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658620:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658627:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658633:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658638:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.658641:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658657:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658666:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951066.658669:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.658672:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.658678:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8dde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951066.658760:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:12433:x1870607923899136:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 640us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.658769:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 210 00000100:00100000:0.0:1783951066.705637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.705765:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923899392 00000100:00100000:2.0:1783951066.705775:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923899392 00000100:00100000:2.0:1783951066.705884:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 211 00000100:00100000:2.0:1783951066.705895:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+35:12436:x1870607923899392:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951066.705918:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951066.705941:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8de5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f879 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706012:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706027:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706039:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706053:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706060:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706066:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706306:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8dfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706317:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8dfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706325:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8dfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951066.706335:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783951066.706413:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706420:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706426:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706432:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951066.706437:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706444:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706458:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951066.706461:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951066.706466:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706482:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8dec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706497:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706503:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706508:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706513:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951066.706516:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706521:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706529:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e0247828f00) 00010000:00010000:2.0:1783951066.706532:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951066.706534:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706540:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706578:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8de5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f879 expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706591:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8dfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f879 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.706605:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:2.0:1783951066.706607:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783951066.706610:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609c00, rc 0) 00000100:00100000:2.0:1783951066.706676:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:12436:x1870607923899392:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 783us (1049us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783951066.706684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 211 00000100:00100000:3.0:1783951066.711259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951066.711672:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923899520 00000100:00100000:0.0:1783951066.711682:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923899520 00000100:00100000:0.0:1783951066.711752:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 212 00000100:00100000:0.0:1783951066.711762:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:12436:x1870607923899520:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:0.0:1783951066.711847:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.711866:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.711877:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.711915:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.711930:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 37 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951066.711945:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944925568:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951066.712171:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0343881300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951066.715424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951066.715598:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944925568:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951066.715628:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951066.716120:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923899776 00000100:00100000:1.0:1783951066.716128:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923899776 00000100:00100000:1.0:1783951066.716219:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1783951066.716229:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:10801:x1870607923899776:12345-192.168.202.33@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783951066.717012:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:10801:x1870607923899776:12345-192.168.202.33@tcp:35:ldlm_bl.0 Request processed in 780us (1594us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1783951066.717021:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1783951066.723067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951066.723201:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923899904 00000100:00100000:3.0:1783951066.723211:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923899904 00010000:00010000:3.0:1783951066.723255:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 39 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951066.723328:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 95 00000100:00100000:3.0:1783951066.723338:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034a669c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:2407:x1870607923899904:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951066.723355:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951066.723363:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 39 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.723377:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 39 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.723400:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8d9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f85d expref: 39 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.723418:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:3.0:1783951066.723423:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.723434:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.723454:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951066.723984:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951066.724051:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034a669c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:2407:x1870607923899904:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 712us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951066.724059:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 95 00010000:00010000:0.0:1783951066.726208:0:11194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726224:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726274:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726281:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726288:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726293:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951066.726298:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726304:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726320:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:0.0:1783951066.726322:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951066.726327:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.726333:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951066.726411:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:12436:x1870607923899520:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 14647us (15162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951066.726449:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 212 00000100:00100000:1.0:1783951066.741620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.741696:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923900160 00000100:00100000:2.0:1783951066.741706:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923900160 00000100:00100000:2.0:1783951066.741966:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:2.0:1783951066.741979:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+37:12436:x1870607923900160:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951066.742247:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:12436:x1870607923900160:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 270us (635us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1783951066.742257:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1783951066.806749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.806846:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923900416 00000100:00100000:1.0:1783951066.806856:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923900416 00000100:00100000:1.0:1783951066.806911:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 213 00000100:00100000:1.0:1783951066.806919:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+38:12447:x1870607923900416:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:1.0:1783951066.806948:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951066.806966:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8e0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f880 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807026:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807037:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807045:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807056:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807060:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807064:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807189:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8e24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807195:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807199:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951066.807206:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1783951066.807284:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807291:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807300:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807306:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.807310:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807316:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807328:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951066.807331:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.807335:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807341:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67c00/0x7645c8e1169f8e16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807352:0:10105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807357:0:10105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807363:0:10105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807376:0:10105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951066.807379:0:10105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807384:0:10105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807391:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e0347f05b00) 00010000:00010000:1.0:1783951066.807394:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951066.807408:0:10105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.807414:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8e1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.807567:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f8e0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f880 expref: 41 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.807587:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8e24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f880 expref: 40 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.807594:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:2.0:1783951066.807597:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951066.807599:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67000, rc 0) 00000100:00100000:2.0:1783951066.807737:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+40:12447:x1870607923900416:12345-192.168.202.33@tcp:101:cat.0 Request processed in 817us (998us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1783951066.807745:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 213 00000100:00100000:0.0:1783951066.811582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.811733:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923900672 00000100:00100000:1.0:1783951066.811743:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923900672 00000100:00100000:1.0:1783951066.811809:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:1.0:1783951066.811821:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+40:12447:x1870607923900672:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:1.0:1783951066.812116:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+41:12447:x1870607923900672:12345-192.168.202.33@tcp:35:cat.0 Request processed in 297us (542us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1783951066.812129:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:1.0:1783951066.853133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.854119:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923900928 00000100:00100000:1.0:1783951066.854130:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923900928 00000100:00100000:0.0:1783951066.854540:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 214 00000100:00100000:0.0:1783951066.854550:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+41:12448:x1870607923900928:12345-192.168.202.33@tcp:36:rm.0 00010000:00010000:0.0:1783951066.854601:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1783951066.854624:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f8dc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f86b expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854661:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8e24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f880 expref: 40 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854675:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f8dfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f879 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854688:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8db4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f864 expref: 38 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854698:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:0.0:1783951066.854703:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951066.854727:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854741:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854752:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854787:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854823:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854831:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854904:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854910:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.854914:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951066.855105:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1783951066.855117:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 422502973718ns, next at 423502970998ns, rc = 0 00010000:00010000:0.0:1783951066.855221:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855231:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855240:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855248:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855264:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855270:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855293:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951066.855313:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855318:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855324:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855330:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951066.855334:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855341:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855350:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:0.0:1783951066.855352:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783951066.855356:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855361:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855377:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855389:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855394:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855399:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951066.855402:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855408:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855416:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951066.855418:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951066.855421:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855426:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951066.855434:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4236feb reply state 00000000e70c5253 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855445:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.855450:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:0.0:1783951066.855452:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951066.855455:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951066.855535:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:12448:x1870607923900928:12345-192.168.202.33@tcp:36:rm.0 Request processed in 985us (2408us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783951066.855549:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 214 00010000:00010000:1.0:1783951066.856069:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951066.856077:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.856095:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951066.856099:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.856105:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.856116:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951066.856118:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951066.856123:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.856128:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e47 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.856170:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951066.856172:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951066.856174:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951066.907697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951066.908119:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923901184 00000100:00100000:0.0:1783951066.908129:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923901184 00000100:00100000:0.0:1783951066.908237:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 215 00000100:00100000:0.0:1783951066.908248:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+39:12454:x1870607923901184:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951066.908275:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951066.908295:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f887 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.908399:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.908416:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.908428:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.908439:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.908446:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.908452:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951066.909281:0:11194:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783951066.909439:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909529:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909539:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909582:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909590:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909597:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909604:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951066.909608:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909617:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909629:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951066.909632:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951066.909708:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909716:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8e55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951066.909731:0:11194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000300580f6 reply state 00000000700f93f6 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909751:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909758:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:0.0:1783951066.909761:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951066.909763:0:11194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951066.909873:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8e4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 42 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909890:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 41 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951066.909897:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:0.0:1783951066.909900:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951066.909903:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3800, rc 0) 00000100:00100000:0.0:1783951066.910241:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12454:x1870607923901184:12345-192.168.202.33@tcp:101:bash.0 Request processed in 1993us (2552us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783951066.910250:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 215 00000100:00100000:0.0:1783951066.915751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.919088:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923901312 00000100:00100000:2.0:1783951066.919105:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923901312 00000100:00100000:2.0:1783951066.919253:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:2.0:1783951066.919265:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2407:x1870607923901312:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951066.919285:0:9851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951066.919304:0:9851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f88e expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951066.919512:0:9851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951066.919533:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1783951066.919536:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951066.919544:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 8 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.919558:0:9851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 8 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.919569:0:9851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609600, rc 0) 00000100:00100000:2.0:1783951066.919625:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2407:x1870607923901312:12345-192.168.202.33@tcp:101:bash.0 Request processed in 363us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951066.919633:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00080000:0.0:1783951066.920344:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951066.926971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.927133:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923901440 00000100:00100000:1.0:1783951066.927318:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923901440 00000100:00100000:1.0:1783951066.927421:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:1.0:1783951066.927432:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:12454:x1870607923901440:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951066.927451:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951066.927481:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f895 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.927517:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.927550:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951066.927555:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951066.927562:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.927598:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.927612:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951066.927627:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1870607944925696:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951066.927740:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951066.931596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951066.931732:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1870607944925696:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951066.931767:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951066.931802:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67600, rc 0) 00000100:00100000:1.0:1783951066.931868:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:12454:x1870607923901440:12345-192.168.202.33@tcp:101:bash.0 Request processed in 4438us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951066.931876:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:2.0:1783951066.931976:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923901568 00000100:00100000:2.0:1783951066.931983:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923901568 00010000:00010000:2.0:1783951066.932019:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951066.932077:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 96 00000100:00100000:2.0:1783951066.932087:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923901568:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951066.932104:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951066.932128:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.932279:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.932305:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc3754b3/0x7645c8e1169f8e71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f88e expref: 9 pid: 9851 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.932319:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951066.932324:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951066.932332:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.932343:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951066.932378:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951066.932392:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1870607944925824:192.168.202.33@tcp:105: 00000100:00100000:2.0:1783951066.932452:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347f0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951066.935698:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1870607944925824:192.168.202.33@tcp:105: 00010000:00010000:3.0:1783951066.935725:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951066.935783:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923901568:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 3697us (4196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951066.935805:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 96 00000100:00100000:0.0:1783951066.937690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951066.937768:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923901824 00000100:00100000:2.0:1783951066.937778:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923901824 00000100:00100000:2.0:1783951066.937849:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:2.0:1783951066.937860:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+42:12454:x1870607923901824:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:2.0:1783951066.938216:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:12454:x1870607923901824:12345-192.168.202.33@tcp:35:bash.0 Request processed in 357us (532us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1783951066.938224:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:3.0:1783951067.127120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.127464:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923901952 00000100:00100000:2.0:1783951067.127474:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923901952 00000100:00100000:2.0:1783951067.127541:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 216 00000100:00100000:2.0:1783951067.127553:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+43:12470:x1870607923901952:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951067.127581:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951067.128067:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f89c expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.128138:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8e86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.128204:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8e86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.128217:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8e86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951067.128284:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783951067.128288:0:10105:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951067.128308:0:10105:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8e86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.128350:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609600/0x7645c8e1169f8e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f89c expref: 45 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.130868:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8e86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f89c expref: 44 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.130881:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951067.130884:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951067.130887:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608a00, rc 0) 00000100:00100000:2.0:1783951067.131040:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+44:12470:x1870607923901952:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 3488us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951067.131049:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 216 00000100:00100000:0.0:1783951067.149972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.155068:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923902208 00000100:00100000:3.0:1783951067.155084:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923902208 00000100:00100000:3.0:1783951067.155245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 217 00000100:00100000:3.0:1783951067.155259:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+44:12470:x1870607923902208:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951067.155284:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951067.155379:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8e8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8a3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.155760:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8e94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.155775:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.155914:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951067.155928:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783951067.156047:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8e8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8a3 expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.156089:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8a3 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.156097:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:3.0:1783951067.156100:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951067.156103:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030800, rc 0) 00000100:00100000:3.0:1783951067.157060:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+46:12470:x1870607923902208:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1799us (7093us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1783951067.157070:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 217 00000100:00100000:3.0:1783951067.169776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.169829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.169923:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923902464 00000100:00100000:0.0:1783951067.169934:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923902464 00000100:00100000:0.0:1783951067.170010:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 218 00000100:00100000:0.0:1783951067.170020:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+46:12470:x1870607923902464:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951067.170048:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951067.170085:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ea2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8aa expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.170236:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8ea9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.170252:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.170266:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951067.170283:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783951067.170408:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169f8ea2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8aa expref: 49 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.170427:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8aa expref: 48 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.170436:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:0.0:1783951067.170440:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783951067.170443:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2a00, rc 0) 00000100:00100000:0.0:1783951067.170509:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+48:12470:x1870607923902464:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 489us (742us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1783951067.170518:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 218 00000100:00100000:2.0:1783951067.170762:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923902592 00000100:00100000:2.0:1783951067.170767:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923902592 00000100:00100000:2.0:1783951067.170818:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783951067.170825:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+48:2408:x1870607923902592:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951067.170835:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951067.170849:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8e94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8a3 expref: 48 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.170862:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:2.0:1783951067.170865:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951067.170899:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:2408:x1870607923902592:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 75us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951067.170907:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:3.0:1783951067.199978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.200076:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923902720 00000100:00100000:0.0:1783951067.200090:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923902720 00000100:00100000:0.0:1783951067.200197:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:0.0:1783951067.200210:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2410:x1870607923902720:12345-192.168.202.33@tcp:1:lfs.0 00010000:00010000:0.0:1783951067.200273:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.200294:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.200303:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951067.200307:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951067.200312:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.200358:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.200373:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 8 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951067.200389:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1870607944925952:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951067.200476:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951067.209913:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1870607944925952:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951067.210071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00010000:00010000:3.0:1783951067.210390:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.210429:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923902848 00000100:00100000:1.0:1783951067.210438:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923902848 00002000:00100000:1.0:1783951067.210661:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9e024860c700 x1870607923902848/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:83/0 lens 504/0 e 0 to 0 dl 1783951078 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951067.210678:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024860c700 with x1870607923902848 ext(0->8) 00010000:00010000:1.0:1783951067.210686:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.210701:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951067.210709:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e024860c700 00000100:00100000:0.0:1783951067.211807:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1783951067.211822:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923902848:12345-192.168.202.33@tcp:4:lfs.0 00000100:00100000:0.0:1783951067.215209:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2407:x1870607923902848:12345-192.168.202.33@tcp:4:lfs.0 Request processed in 3020us (4768us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783951067.215223:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00002000:00100000:0.0:1783951067.215237:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9e024860c700 x1870607923902848/t4294967309(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:83/0 lens 504/448 e 0 to 0 dl 1783951078 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783951067.215258:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024860c700 with x1870607923902848 ext(0->8) 00010000:00010000:0.0:1783951067.215270:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 11 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.215287:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 11 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951067.215295:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e024860c700 00000001:00080000:0.0:1783951067.219049:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1783951067.219069:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1783951067.227327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.227421:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923902976 00000100:00100000:3.0:1783951067.227432:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923902976 00010000:00010000:3.0:1783951067.227478:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 7 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951067.227532:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00100000:3.0:1783951067.227544:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923902976:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951067.227562:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783951067.227598:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783951067.227601:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783951066 00002000:00010000:3.0:1783951067.227603:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783951067 00002000:00010000:3.0:1783951067.227605:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783951066 00002000:00010000:3.0:1783951067.227607:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783951067.227613:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 7 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.227627:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 7 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.227651:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec781971/0x7645c8e1169f8e78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f895 expref: 7 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.227681:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951067.227686:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951067.227693:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.227703:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.227741:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951067.227820:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+6:2408:x1870607923902976:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 277us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951067.227829:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 97 00010000:00010000:0.0:1783951067.228170:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228182:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228204:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228212:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228219:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228239:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951067.228244:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228252:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228264:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.228272:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf11585/0x7645c8e1169f8eb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951067.228331:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923902720:12345-192.168.202.33@tcp:1:lfs.0 Request processed in 28124us (28364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.228340:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:0.0:1783951067.232233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.232502:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923903232 00000100:00100000:2.0:1783951067.232511:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923903232 00000100:00100000:2.0:1783951067.232557:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:2.0:1783951067.232565:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+47:12470:x1870607923903232:12345-192.168.202.33@tcp:35:lfs.0 00000004:00010000:2.0:1783951067.232618:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8aa expref: 47 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951067.233120:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1783951067.233199:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1783951067.233507:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1783951067.233550:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.233568:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 51 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.233578:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.233613:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 51 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.233628:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 51 pid: 11194 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951067.233658:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1870607944926080:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951067.234223:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347f0e600 going to sleep for 11 seconds 00010000:00010000:3.0:1783951067.234382:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951067.238269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.238404:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923903360 00000100:00100000:0.0:1783951067.238415:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923903360 00010000:00010000:0.0:1783951067.238459:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 52 pid: 11194 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951067.238504:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 98 00000100:00100000:0.0:1783951067.238515:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:2407:x1870607923903360:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951067.238530:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951067.238553:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 52 pid: 11194 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.238565:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 52 pid: 11194 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.238587:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:0.0:1783951067.238592:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.238603:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.238610:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.238629:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951067.238711:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+52:2407:x1870607923903360:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 196us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.238719:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 98 00010000:00010000:2.0:1783951067.239195:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3800/0x7645c8e1169f8e63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f887 expref: 51 pid: 11194 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951067.239226:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1870607944926080:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951067.239248:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.239267:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.239274:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951067.239392:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1783951067.239510:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1783951067.239587:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944926208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783951067.239646:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951067.239756:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944926208 00000100:00100000:1.0:1783951067.239761:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944926208 00000100:00100000:1.0:1783951067.239815:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783951067.239824:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1870607944926208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783951067.239899:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1870607944926208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951067.239906:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783951067.240079:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0345c056c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951067.240093:0:6529:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1783951067.240097:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1783951067.240111:0:6529:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0248397480, transno 4294967308 00000100:00100000:2.0:1783951067.240128:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944926208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783951067.240295:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1783951067.240341:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944926336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783951067.240367:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951067.240393:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951067.240478:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944926336 00000100:00100000:1.0:1783951067.240483:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944926336 00000100:00100000:1.0:1783951067.240516:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783951067.240523:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1870607944926336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783951067.240628:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1870607944926336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (260us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783951067.240646:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783951067.241093:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1870607944926336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783951067.241138:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1783951067.241205:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.241225:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.241232:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.241239:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951067.241244:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.241251:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.241477:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:2.0:1783951067.241480:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783951067.241485:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.241492:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ebe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783951067.241598:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783951067.241803:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1783951067.241818:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422889675102ns, next at 423889672767ns, rc = 0 00000001:00080000:2.0:1783951067.241827:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1783951067.241854:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e024782ea00) 00010000:00010000:2.0:1783951067.241857:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783951067.241865:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f8ea9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8aa expref: 55 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951067.242276:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:12470:x1870607923903232:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 9709us (10049us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783951067.242286:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000020:00080000:2.0:1783951067.242290:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783951067.246594:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.248593:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923903488 00000100:00100000:2.0:1783951067.248609:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923903488 00000100:00100000:2.0:1783951067.249285:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 219 00000100:00100000:2.0:1783951067.249295:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+54:12470:x1870607923903488:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951067.249321:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951067.249345:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ec5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8b1 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.249411:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b1 expref: 55 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.249427:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b1 expref: 55 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.249447:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:2.0:1783951067.249451:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951067.249455:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609200, rc 0) 00000100:00100000:2.0:1783951067.249531:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:12470:x1870607923903488:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 237us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951067.249539:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 219 00000100:00100000:1.0:1783951067.260712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.260930:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923903744 00000100:00100000:0.0:1783951067.260941:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923903744 00000100:00100000:0.0:1783951067.261005:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:0.0:1783951067.261015:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+55:12470:x1870607923903744:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1783951067.261309:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12470:x1870607923903744:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 293us (606us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783951067.261317:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1783951067.392926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.393007:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923903872 00000100:00100000:3.0:1783951067.393018:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923903872 00000100:00100000:3.0:1783951067.393083:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 220 00000100:00100000:3.0:1783951067.393093:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12480:x1870607923903872:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:3.0:1783951067.393203:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393222:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393236:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393248:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393256:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393264:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393349:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393356:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393362:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951067.393414:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393438:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393444:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393451:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393457:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951067.393461:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393468:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393480:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:3.0:1783951067.393482:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951067.393486:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393492:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030400/0x7645c8e1169f8ecc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393506:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393512:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393518:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393527:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951067.393530:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393535:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393543:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:3.0:1783951067.393545:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951067.393548:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393554:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340030800/0x7645c8e1169f8ed3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393563:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393570:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393576:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393581:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951067.393584:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393590:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393609:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:3.0:1783951067.393611:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951067.393614:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.393619:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8eda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951067.394263:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12480:x1870607923903872:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 1166us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951067.394277:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 220 00000100:00100000:1.0:1783951067.432035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.432193:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923904128 00000100:00100000:0.0:1783951067.432203:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923904128 00000100:00100000:0.0:1783951067.432553:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 221 00000100:00100000:0.0:1783951067.432562:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+56:12483:x1870607923904128:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951067.432581:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951067.432599:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8ee1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8b8 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432807:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432823:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432834:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432846:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432852:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432856:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432958:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432963:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.432967:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951067.432983:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783951067.433056:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433061:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433065:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433069:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951067.433073:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433077:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433086:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951067.433088:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951067.433091:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433095:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8ee8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433104:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433107:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433117:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433121:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951067.433122:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433126:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433130:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:0.0:1783951067.433131:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951067.433133:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433136:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433209:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8ee1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 59 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433223:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 58 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.433230:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.433232:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951067.433235:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5de00, rc 0) 00000100:00100000:0.0:1783951067.433371:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12483:x1870607923904128:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 808us (1344us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1783951067.433388:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 221 00000100:00100000:1.0:1783951067.436396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.436440:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923904256 00000100:00100000:0.0:1783951067.436449:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923904256 00000100:00100000:0.0:1783951067.436496:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 222 00000100:00100000:0.0:1783951067.436507:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12483:x1870607923904256:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:0.0:1783951067.436570:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436583:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436592:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436623:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436628:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436634:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436640:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951067.436645:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436652:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436662:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.436679:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951067.436685:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.436691:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8f04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951067.436768:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12483:x1870607923904256:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 262us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.436776:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 222 00000100:00100000:1.0:1783951067.442215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.442282:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923904512 00000100:00100000:2.0:1783951067.442291:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923904512 00000100:00100000:2.0:1783951067.442364:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:2.0:1783951067.442375:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+58:12483:x1870607923904512:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951067.442602:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:12483:x1870607923904512:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 228us (393us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1783951067.442612:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:1.0:1783951067.491929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.492097:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923904768 00000100:00100000:3.0:1783951067.492107:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923904768 00000100:00100000:3.0:1783951067.492197:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 223 00000100:00100000:3.0:1783951067.492207:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:12493:x1870607923904768:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951067.492233:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951067.492236:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783951067.492273:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8e86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f89c expref: 59 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.492295:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:3.0:1783951067.492301:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951067.492316:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8f0b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8bf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.492448:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.492975:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 59 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.492985:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.493022:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 59 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.493035:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 59 pid: 11194 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951067.493050:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926464:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951067.493243:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951067.496950:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926464:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951067.496984:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.497699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.498569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923904896 00000100:00100000:3.0:1783951067.498578:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923904896 00010000:00010000:3.0:1783951067.498615:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 60 pid: 11194 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951067.498835:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 99 00000100:00100000:3.0:1783951067.498846:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:2408:x1870607923904896:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951067.498864:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951067.498886:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 60 pid: 11194 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.498899:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 60 pid: 11194 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.498921:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8ef6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b8 expref: 60 pid: 11194 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.498934:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:3.0:1783951067.498938:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.499137:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.499171:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.499209:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951067.499259:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.499269:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951067.499290:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783951067.499439:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f8f0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951067.499523:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:2408:x1870607923904896:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 677us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951067.499532:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 99 00010000:00010000:1.0:1783951067.500191:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.500202:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951067.500205:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951067.500208:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:1.0:1783951067.500243:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:12493:x1870607923904768:12345-192.168.202.33@tcp:101:bash.0 Request processed in 8038us (8324us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1783951067.500252:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 223 00000100:00100000:1.0:1783951067.503421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.503596:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923905024 00000100:00100000:0.0:1783951067.503605:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923905024 00000100:00100000:0.0:1783951067.504062:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 224 00000100:00100000:0.0:1783951067.504075:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+59:12493:x1870607923905024:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1783951067.504103:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951067.504125:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8f20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8c6 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.504181:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.504192:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.504201:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.504319:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f8f20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 61 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.504351:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 60 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.504360:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.504363:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951067.504367:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d200, rc 0) 00000100:00100000:0.0:1783951067.504424:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:12493:x1870607923905024:12345-192.168.202.33@tcp:101:bash.0 Request processed in 353us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.504430:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 224 00000100:00100000:0.0:1783951067.508130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.508363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923905280 00000100:00100000:2.0:1783951067.508372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923905280 00000100:00100000:2.0:1783951067.508429:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 225 00000100:00100000:2.0:1783951067.508440:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+60:12493:x1870607923905280:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:2.0:1783951067.508667:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.508684:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.508695:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951067.508746:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1783951067.508769:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a649c52 reply state 00000000b96b4cd2 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.508780:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.508801:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:2.0:1783951067.508804:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951067.508807:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951067.508898:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12493:x1870607923905280:12345-192.168.202.33@tcp:36:bash.0 Request processed in 459us (777us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783951067.508923:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 225 00000020:00080000:2.0:1783951067.509532:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783951067.512232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951067.512367:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923905408 00000100:00100000:1.0:1783951067.512375:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923905408 00000100:00100000:1.0:1783951067.512426:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 226 00000100:00100000:1.0:1783951067.512452:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12493:x1870607923905408:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951067.512478:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951067.512501:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8f35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8cd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.512601:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.512612:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.512618:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.512650:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.512663:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 64 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.512677:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247aa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926592:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951067.512760:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951067.516089:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247aa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926592:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951067.516121:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951067.516202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.516243:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923905536 00000100:00100000:0.0:1783951067.516251:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923905536 00010000:00010000:0.0:1783951067.516304:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 65 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951067.516344:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 100 00000100:00100000:0.0:1783951067.516353:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:2407:x1870607923905536:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951067.516371:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951067.516377:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 65 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.516389:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 65 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.516412:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f8f12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8bf expref: 65 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.516451:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.516469:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.516479:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.516487:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.516522:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951067.516587:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:2407:x1870607923905536:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 234us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.516595:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 100 00010000:00010000:1.0:1783951067.516610:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.516618:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951067.516689:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783951067.516700:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951067.516724:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.516756:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8f35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.516771:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.516779:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951067.516782:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951067.516794:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951067.516823:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12493:x1870607923905408:12345-192.168.202.33@tcp:101:bash.0 Request processed in 4373us (4597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951067.516831:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 226 00000100:00100000:1.0:1783951067.519887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.519966:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923905792 00000100:00100000:0.0:1783951067.519975:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923905792 00000100:00100000:0.0:1783951067.520094:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:0.0:1783951067.520105:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+63:12493:x1870607923905792:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:0.0:1783951067.520390:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12493:x1870607923905792:12345-192.168.202.33@tcp:35:bash.0 Request processed in 286us (511us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1783951067.520398:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:2.0:1783951067.585185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951067.585265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923905920 00000100:00100000:1.0:1783951067.585276:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923905920 00000100:00100000:1.0:1783951067.585340:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 227 00000100:00100000:1.0:1783951067.585351:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+64:12499:x1870607923905920:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951067.585379:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951067.585414:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8f43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8d4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.585493:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8f4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.585508:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.585534:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951067.585583:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783951067.585587:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951067.585607:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.585632:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8f43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8d4 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.585652:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8d4 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.585660:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951067.585663:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951067.585667:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67000, rc 0) 00000100:00100000:1.0:1783951067.585738:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12499:x1870607923905920:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 388us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951067.585746:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 227 00000100:00100000:1.0:1783951067.590563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.590657:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923906048 00000100:00100000:2.0:1783951067.590666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923906048 00000100:00100000:2.0:1783951067.590731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 228 00000100:00100000:2.0:1783951067.590741:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12499:x1870607923906048:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951067.590764:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951067.590801:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8f51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8db expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.590866:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.590881:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.590892:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.590902:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.590908:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.590913:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591009:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591017:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591024:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951067.591067:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783951067.591071:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951067.591088:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591099:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591107:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591115:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591121:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591128:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951067.591132:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591139:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591194:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:2.0:1783951067.591197:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951067.591202:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591208:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169f8f58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591222:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591227:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591232:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591236:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951067.591239:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591245:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591253:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:2.0:1783951067.591255:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951067.591268:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591274:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609a00/0x7645c8e1169f8f5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591314:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f8f51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591327:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951067.591335:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:2.0:1783951067.591337:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951067.591340:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608a00, rc 0) 00000100:00100000:2.0:1783951067.591406:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12499:x1870607923906048:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 666us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951067.591414:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 228 00000100:00100000:2.0:1783951067.599028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.599081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951067.599166:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923906304 00000100:00100000:1.0:1783951067.599176:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923906304 00000100:00100000:1.0:1783951067.599243:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 229 00000100:00100000:1.0:1783951067.599253:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12499:x1870607923906304:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951067.599276:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951067.599298:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8f6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8e2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599441:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599458:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599468:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599477:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599512:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599526:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 67 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.599541:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926720:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951067.599844:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.599855:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 67 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.599866:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926848:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951067.599900:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951067.600375:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923906432 00000100:00100000:3.0:1783951067.600381:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923906432 00010000:00010000:3.0:1783951067.600419:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 68 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951067.600464:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 101 00000100:00100000:3.0:1783951067.600473:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343129c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:2408:x1870607923906432:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951067.600485:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951067.600491:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 68 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.600504:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 68 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.600521:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:3.0:1783951067.600526:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.600533:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951067.600540:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951067.600581:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343129c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:2408:x1870607923906432:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 109us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951067.600588:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 101 00000100:00100000:2.0:1783951067.606571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.606779:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923906560 00000100:00100000:0.0:1783951067.606799:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923906560 00010000:00010000:0.0:1783951067.606847:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 68 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951067.606892:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 102 00000100:00100000:0.0:1783951067.606920:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:2407:x1870607923906560:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951067.606937:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951067.606944:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 68 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.606959:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 68 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.606982:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.606988:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.606998:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.607006:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.607026:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951067.607085:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:2407:x1870607923906560:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 166us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.607093:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 102 00010000:00010000:1.0:1783951067.609070:0:6527:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.33@tcp) returned -22 from blocking AST (req@0000000006d6b534 x1870607944926720) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 67 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.609094:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608a00/0x7645c8e1169f8f66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8db expref: 67 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.609115:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926720:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951067.609133:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8f3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8cd expref: 66 pid: 6527 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951067.609196:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1870607944926848:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951067.609217:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951067.609224:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.609231:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.609236:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951067.609265:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783951067.609576:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8f6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.609592:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951067.609614:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951067.609617:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951067.609619:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951067.610087:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12499:x1870607923906304:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 10833us (11066us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783951067.610096:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 229 00000100:00100000:3.0:1783951067.613938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.614045:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923906816 00000100:00100000:0.0:1783951067.614055:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923906816 00000100:00100000:0.0:1783951067.614120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1783951067.614132:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12499:x1870607923906816:12345-192.168.202.33@tcp:103:lfs.0 00010000:00010000:0.0:1783951067.614212:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951067.614234:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f8ec5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8b1 expref: 66 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.614435:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.614440:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951067.614567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12499:x1870607923906816:12345-192.168.202.33@tcp:103:lfs.0 Request processed in 438us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.614573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951067.617015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.617065:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923906944 00000100:00100000:0.0:1783951067.617076:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923906944 00000100:00100000:0.0:1783951067.617201:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 230 00000100:00100000:0.0:1783951067.617215:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12499:x1870607923906944:12345-192.168.202.33@tcp:58:lfs.0 00010000:00010000:0.0:1783951067.617530:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.617548:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.617560:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951067.617730:0:10105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1783951067.617836:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12499:x1870607923906944:12345-192.168.202.33@tcp:58:lfs.0 Request processed in 624us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.617845:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 230 00000100:00100000:2.0:1783951067.620585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.620649:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907072 00000100:00100000:0.0:1783951067.620659:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907072 00000100:00100000:0.0:1783951067.620718:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 231 00000100:00100000:0.0:1783951067.620728:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348a73c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+65:12499:x1870607923907072:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951067.620747:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951067.620777:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8e9 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.620849:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.620865:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 66 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.620888:0:11194:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.620900:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 66 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.620913:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951067.620916:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951067.620919:0:11194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 66 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951067.620927:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c000, rc 0) 00000100:00100000:0.0:1783951067.620987:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348a73c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12499:x1870607923907072:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 260us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.620995:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 231 00000100:00100000:3.0:1783951067.906076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.906112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.906136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.906253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951067.906305:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907200 00000100:00100000:0.0:1783951067.906315:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907200 00000100:00100000:0.0:1783951067.906367:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 392 00000100:00100000:0.0:1783951067.906374:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923907200:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951067.906446:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2407:x1870607923907200:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951067.906475:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 392 00000100:00100000:1.0:1783951067.906653:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907456 00000100:00100000:1.0:1783951067.906657:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907456 00000100:00100000:1.0:1783951067.906696:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:1.0:1783951067.906705:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923907456:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951067.906739:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923907456:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 37us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951067.906744:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:3.0:1783951067.907401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951067.907496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951067.907800:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907712 00000100:00100000:2.0:1783951067.907807:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907712 00000100:00080000:2.0:1783951067.907835:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951067.907937:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907328 00000100:00100000:2.0:1783951067.907941:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907328 00000100:00080000:2.0:1783951067.907966:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951067.907991:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 323 00000100:00100000:2.0:1783951067.908002:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923907712:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951067.908057:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923907712:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 57us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951067.908072:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 323 00000100:00100000:2.0:1783951067.908089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 324 00000100:00100000:2.0:1783951067.908095:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923907328:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951067.908125:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2407:x1870607923907328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951067.908131:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 324 00000100:00100000:1.0:1783951067.908364:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907584 00000100:00100000:1.0:1783951067.908369:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907584 00000100:00100000:1.0:1783951067.908542:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:1.0:1783951067.908552:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923907584:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951067.908590:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2407:x1870607923907584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 40us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951067.908597:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:1.0:1783951067.909288:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907840 00000100:00100000:1.0:1783951067.909295:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907840 00000100:00100000:1.0:1783951067.909348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 325 00000100:00100000:1.0:1783951067.909356:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923907840:12345-192.168.202.33@tcp:400:kworker.0 00000100:00080000:2.0:1783951067.909480:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951067.910215:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7ffa451-5324-4858-a00e-bb5627316d28+5:2407:x1870607923907840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 856us (2715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951067.910225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 325 00010000:00010000:1.0:1783951068.256818:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951068.256907:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944926976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951068.256986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951068.257837:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944926976 00000100:00100000:1.0:1783951068.257847:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944926976 00000100:00100000:1.0:1783951068.257901:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783951068.257911:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944926976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951068.257948:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783951068.258014:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944926976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.258021:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783951068.258204:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944926976:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783951068.320469:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951068.320479:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951068.320509:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1783951068.320519:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951068.321768:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944927104:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951068.321974:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951068.334724:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944927104:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951068.336022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.336736:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923907968 00000100:00100000:0.0:1783951068.336746:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923907968 00000100:00100000:0.0:1783951068.336834:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 232 00000100:00100000:0.0:1783951068.336846:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12500:x1870607923907968:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783951068.336879:0:11194:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783951068.337177:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12500:x1870607923907968:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 333us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951068.337187:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 232 00000100:00080000:2.0:1783951068.337888:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951068.358751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.358996:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923908096 00000100:00100000:3.0:1783951068.359006:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923908096 00000100:00100000:3.0:1783951068.359079:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 233 00000100:00100000:3.0:1783951068.359090:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12500:x1870607923908096:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783951068.359194:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359211:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359226:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359253:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359261:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359267:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359882:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359895:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.359904:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951068.359984:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783951068.359989:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951068.360003:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360016:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360023:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360030:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360048:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951068.360053:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360061:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360074:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:3.0:1783951068.360077:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951068.360082:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360088:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145000/0x7645c8e1169f8f90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360105:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360122:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360128:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360134:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951068.360138:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360392:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360402:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9e024109e300) 00010000:00010000:3.0:1783951068.360405:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951068.360408:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360414:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145a00/0x7645c8e1169f8f97 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360430:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360435:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360440:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360445:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951068.360454:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360460:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360468:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:3.0:1783951068.360470:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951068.360472:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.360478:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8f9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.360567:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12500:x1870607923908096:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 1475us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.360576:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 233 00000100:00100000:1.0:1783951068.363986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.364090:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923908352 00000100:00100000:0.0:1783951068.364100:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923908352 00000100:00100000:0.0:1783951068.364186:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 234 00000100:00100000:0.0:1783951068.364196:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+66:12500:x1870607923908352:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.364218:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951068.364247:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fa5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8f0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364623:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364640:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364651:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951068.364735:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783951068.364828:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364836:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364842:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364848:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.364853:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364859:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364871:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951068.364874:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951068.364878:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364894:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364938:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fa5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8f0 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364948:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:0.0:1783951068.364951:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951068.364954:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fa5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8f0 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.364963:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5de00, rc 0) 00000100:00100000:0.0:1783951068.365031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12500:x1870607923908352:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 836us (1055us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1783951068.365202:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 234 00000100:00100000:2.0:1783951068.373009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.373426:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923908480 00000100:00100000:3.0:1783951068.373437:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923908480 00000100:00100000:3.0:1783951068.373504:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 235 00000100:00100000:3.0:1783951068.373515:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12500:x1870607923908480:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783951068.373551:0:10105:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783951068.373693:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12500:x1870607923908480:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 179us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.373701:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 235 00000100:00100000:2.0:1783951068.376440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.376902:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923908736 00000100:00100000:3.0:1783951068.376911:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923908736 00000100:00100000:3.0:1783951068.376966:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 236 00000100:00100000:3.0:1783951068.376973:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12500:x1870607923908736:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951068.377003:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951068.377005:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783951068.377033:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f8f4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8d4 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.377059:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:3.0:1783951068.377063:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951068.377074:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8fba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8f7 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951068.381035:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1783951068.381833:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.381853:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.381864:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.381939:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f8fba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8f7 expref: 69 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.382054:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8f7 expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.382063:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e024782e700) 00010000:00010000:0.0:1783951068.382066:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951068.382069:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5de00, rc 0) 00000100:00100000:0.0:1783951068.382424:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:12500:x1870607923908736:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 5449us (5992us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1783951068.382432:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 236 00000100:00100000:2.0:1783951068.392712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.392841:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923908992 00000100:00100000:0.0:1783951068.392851:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923908992 00000100:00100000:0.0:1783951068.392920:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 237 00000100:00100000:0.0:1783951068.392932:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:12500:x1870607923908992:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.393010:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951068.393051:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f8fc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8f7 expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393076:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e024782e700) 00010000:00010000:0.0:1783951068.393088:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951068.393114:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393129:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393138:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393217:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393225:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393232:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393497:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393505:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393511:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393517:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.393521:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393528:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393536:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:0.0:1783951068.393538:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951068.393542:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393548:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f8fcf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393563:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393569:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393574:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393579:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.393582:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393587:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393595:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6d84da74 (ffff9e024782e200) 00010000:00010000:0.0:1783951068.393597:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951068.393600:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.393606:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8fd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6d84da74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.393689:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12500:x1870607923908992:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 758us (985us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951068.393697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 237 00000100:00100000:2.0:1783951068.398499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.398571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923909120 00000100:00100000:1.0:1783951068.398579:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923909120 00000100:00100000:1.0:1783951068.398633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 238 00000100:00100000:1.0:1783951068.398644:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+67:12500:x1870607923909120:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951068.398673:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951068.398696:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8fdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f8fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.398731:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.398744:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.398755:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.398896:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f8fdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.398914:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.398923:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:1.0:1783951068.398927:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951068.398930:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67600, rc 0) 00000100:00100000:1.0:1783951068.399013:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:12500:x1870607923909120:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 370us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.399021:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 238 00000100:00100000:2.0:1783951068.402766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.402860:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923909376 00000100:00100000:0.0:1783951068.402870:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923909376 00000100:00100000:0.0:1783951068.402933:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 239 00000100:00100000:0.0:1783951068.402968:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+68:12500:x1870607923909376:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.403059:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.403076:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.403089:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951068.403388:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1783951068.403398:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424051254880ns, next at 425051252617ns, rc = 0 00000004:00010000:0.0:1783951068.403441:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbbe2676 reply state 00000000390fd1f4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.403452:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.403457:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:0.0:1783951068.403459:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783951068.403461:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951068.403714:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+70:12500:x1870607923909376:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 748us (958us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1783951068.403720:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 239 00000100:00100000:3.0:1783951068.415005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951068.415125:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923909504 00000100:00100000:2.0:1783951068.415135:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923909504 00000100:00100000:2.0:1783951068.415228:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 240 00000100:00100000:2.0:1783951068.415237:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+70:12500:x1870607923909504:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951068.415263:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951068.415286:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f905 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.415351:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 71 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.415380:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 71 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.415397:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:2.0:1783951068.415399:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951068.415402:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608400, rc 0) 00000100:00100000:2.0:1783951068.415456:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+71:12500:x1870607923909504:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 220us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.415464:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 240 00000100:00100000:2.0:1783951068.421247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.421432:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923909632 00000100:00100000:1.0:1783951068.421440:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923909632 00000100:00100000:1.0:1783951068.421527:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:1.0:1783951068.421539:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923909632:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783951068.421765:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2408:x1870607923909632:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 224us (522us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1783951068.421789:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00080000:2.0:1783951068.421943:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951068.423927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951068.423992:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923909888 00000100:00100000:2.0:1783951068.424003:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923909888 00000100:00100000:2.0:1783951068.424074:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:2.0:1783951068.424084:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+71:12500:x1870607923909888:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783951068.424343:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+72:12500:x1870607923909888:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 260us (423us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1783951068.424351:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:3.0:1783951068.427822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951068.427890:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923910144 00000100:00100000:2.0:1783951068.427901:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923910144 00000100:00100000:2.0:1783951068.428087:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 241 00000100:00100000:2.0:1783951068.428099:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+72:12500:x1870607923910144:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783951068.428235:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+72:12500:x1870607923910144:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 138us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.428261:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 241 00000100:00100000:0.0:1783951068.432486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951068.432589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923910272 00000100:00100000:2.0:1783951068.432599:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923910272 00000100:00100000:2.0:1783951068.432667:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 242 00000100:00100000:2.0:1783951068.432676:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+72:12500:x1870607923910272:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951068.432696:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951068.432715:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8ff9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f90c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.432798:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f9000 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.432814:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f9000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.432825:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f9000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951068.432877:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951068.432897:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f9000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.432922:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609e00/0x7645c8e1169f8ff9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f90c expref: 74 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.432940:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f9000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f90c expref: 73 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951068.433323:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:2.0:1783951068.433341:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783951068.433345:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609000, rc 0) 00000100:00100000:2.0:1783951068.433405:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+73:12500:x1870607923910272:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 730us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.433413:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 242 00000100:00100000:3.0:1783951068.437303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.437377:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923910400 00000100:00100000:1.0:1783951068.437388:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923910400 00000100:00100000:1.0:1783951068.437447:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:1.0:1783951068.437458:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+10:2408:x1870607923910400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951068.437478:0:9851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951068.437501:0:9851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f913 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951068.437543:0:9851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54eedc, blocks: 0x0 00010000:00010000:1.0:1783951068.437562:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1783951068.437566:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951068.437576:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 11 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.437594:0:9851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 11 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.437607:0:9851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951068.437679:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2408:x1870607923910400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 223us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.437687:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:3.0:1783951068.440952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.441010:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923910656 00000100:00100000:1.0:1783951068.441020:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923910656 00000100:00100000:1.0:1783951068.441189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 243 00000100:00100000:1.0:1783951068.441199:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+73:12500:x1870607923910656:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951068.441313:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+73:12500:x1870607923910656:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 115us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.442617:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 243 00000100:00100000:0.0:1783951068.445513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.445743:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923910784 00000100:00100000:1.0:1783951068.445753:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923910784 00000100:00100000:1.0:1783951068.445823:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:1.0:1783951068.445833:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:12500:x1870607923910784:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951068.445868:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951068.445887:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f91a expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.445918:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 12 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.445927:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951068.445931:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951068.445937:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.445973:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 12 pid: 9851 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.445987:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 12 pid: 9851 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951068.446001:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944927232:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951068.446465:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951068.450858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.451003:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923910912 00000100:00100000:0.0:1783951068.451013:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923910912 00010000:00010000:0.0:1783951068.451055:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 13 pid: 9851 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.451124:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 103 00000100:00100000:0.0:1783951068.451133:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:2408:x1870607923910912:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951068.451182:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951068.451205:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 13 pid: 9851 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.451220:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 13 pid: 9851 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.451266:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951068.451271:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951068.451289:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 13 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.451300:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 13 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.451337:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 13 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.451350:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1870607944927360:192.168.202.33@tcp:105: 00000100:00100000:0.0:1783951068.451428:0:6509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1783951068.452257:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d538c09e/0x7645c8e1169f9007 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f913 expref: 13 pid: 9851 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951068.452275:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1870607944927232:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951068.452307:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.452330:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66a00, rc 0) 00000100:00100000:1.0:1783951068.452378:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+12:12500:x1870607923910784:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 6546us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.452386:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:0.0:1783951068.456856:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1870607944927360:192.168.202.33@tcp:105: 00010000:00010000:0.0:1783951068.456898:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951068.456962:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2408:x1870607923910912:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 5829us (6114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951068.456973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 103 00000100:00100000:2.0:1783951068.471564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.471671:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923911040 00000100:00100000:1.0:1783951068.471682:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923911040 00002000:00100000:1.0:1783951068.471731:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9e024860ca80 x1870607923911040/t0(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:84/0 lens 504/0 e 0 to 0 dl 1783951079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951068.471744:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024860ca80 with x1870607923911040 ext(0->12) 00002000:00010000:1.0:1783951068.471749:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e024860ca80 00000100:00100000:2.0:1783951068.471914:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1783951068.471928:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+11:2407:x1870607923911040:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783951068.482214:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:2407:x1870607923911040:12345-192.168.202.33@tcp:4:lhsmtool_posix.0 Request processed in 10278us (10645us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783951068.482229:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00002000:00100000:0.0:1783951068.482257:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9e024860ca80 x1870607923911040/t4294967321(0) o4->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:84/0 lens 504/448 e 0 to 0 dl 1783951079 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783951068.482268:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024860ca80 with x1870607923911040 ext(0->12) 00002000:00010000:0.0:1783951068.483004:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e024860ca80 00000100:00100000:1.0:1783951068.485820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.486492:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923911168 00000100:00100000:0.0:1783951068.486503:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923911168 00000100:00100000:0.0:1783951068.486571:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 244 00000100:00100000:0.0:1783951068.486581:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+73:12500:x1870607923911168:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783951068.489472:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1783951068.489493:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1783951068.489529:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1783951068.489552:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e0343881300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1783951068.489557:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e034928c100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e037e4133c0 00000020:00080000:3.0:1783951068.489560:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e034928cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e02479f4c00 00000004:00080000:3.0:1783951068.489584:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783951068.489610:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e03432dd900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1783951068.489613:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e03485e9500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e03432ddf00 00000020:00080000:3.0:1783951068.489616:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e03485e9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e02481b1000 00000020:00080000:3.0:1783951068.489667:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1783951068.489687:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1783951068.489759:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783951068.490199:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944927616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783951068.490275:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951068.490331:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951068.490338:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944927744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783951068.490361:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951068.490394:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944927488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783951068.490420:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951068.490453:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944927616 00000100:00100000:0.0:1783951068.490459:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944927616 00000100:00100000:0.0:1783951068.490509:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944927744 00000100:00100000:0.0:1783951068.490520:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944927744 00000100:00100000:0.0:1783951068.490537:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944927488 00000100:00100000:0.0:1783951068.490539:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944927488 00000100:00100000:0.0:1783951068.490552:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951068.490559:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944927616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783951068.490688:0:9851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783951068.490692:0:9851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783951068 00002000:00010000:0.0:1783951068.490694:0:9851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783951068.490696:0:9851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1783951068 -> 1783951068 00002000:00010000:0.0:1783951068.490698:0:9851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783951068.490739:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3654:x1870607944927616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (463us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1783951068.490746:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951068.490762:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783951068.490768:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607944927744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783951068.491190:0:9851:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1783951068.491221:0:9851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a54eeda, atime: 0x6a54eedb, ctime: 0x6a54eeda, blocks: 0x8 00010000:00010000:0.0:1783951068.491228:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491244:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1783951068.491248:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951068.491254:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491270:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491359:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491368:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491388:0:9851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783951068.491503:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944927744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 734us (1139us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783951068.491510:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783951068.491527:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783951068.491533:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607944927488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783951068.491549:0:9851:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1783951068.491561:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491574:0:9851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491581:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783951068.491584:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951068.491588:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491615:0:9851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.491878:0:9851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 12 pid: 8440 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.491892:0:9851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9851:1870607944927872:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951068.492049:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12500:x1870607923911168:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 5468us (6238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.492058:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 244 00000100:00080000:3.0:1783951068.492111:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951068.492115:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1783951068.492179:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0248334700/2, rc 0, transno 4294967311 00000100:00100000:3.0:1783951068.492186:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944927744:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1783951068.492199:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e024860c000/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783951068.492204:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944927616:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1783951068.493029:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951068.493038:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.493050:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951068.493055:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.493065:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.493086:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.493114:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011f9c5f1/0x7645c8e1169f9015 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.493137:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951068.493138:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951068.493140:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951068.493247:0:9851:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951068.497264:0:9851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9851:1870607944927872:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951068.497308:0:9851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.498272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.498432:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923911296 00000100:00100000:0.0:1783951068.498439:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923911296 00000100:00100000:0.0:1783951068.498496:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:0.0:1783951068.498505:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+13:2409:x1870607923911296:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1783951068.498913:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.498925:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.498933:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.498940:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.498976:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.498985:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499001:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e024109e600) 00010000:00010000:1.0:1783951068.499012:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.499017:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499024:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031600/0x7645c8e1169f8d13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499058:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499063:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499069:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499074:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.499076:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499081:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499088:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e0347f05200) 00010000:00010000:1.0:1783951068.499091:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.499093:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499099:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609800/0x7645c8e1169f8dbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499115:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499130:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499135:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499157:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.499160:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499167:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499175:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:1.0:1783951068.499178:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.499181:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499187:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169f8e39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499200:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499206:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499212:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499217:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.499225:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499232:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499240:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e300) 00010000:00010000:1.0:1783951068.499242:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.499245:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499251:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f8e5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499864:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499872:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499878:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499882:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.499885:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499890:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499902:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951068.499904:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.499914:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499920:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608e00/0x7645c8e1169f8f2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.499937:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.500411:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.500421:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.500427:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.500429:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.500436:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.500445:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:1.0:1783951068.500447:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783951068.500450:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.500456:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f8feb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783951068.502042:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1783951068.502059:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1783951068.504675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951068.504784:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923911424 00000100:00100000:1.0:1783951068.504794:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923911424 00010000:00010000:1.0:1783951068.504838:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 9 pid: 8440 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951068.504895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 104 00000100:00100000:1.0:1783951068.504904:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2410:x1870607923911424:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951068.504921:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951068.504926:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 9 pid: 8440 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.504940:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 9 pid: 8440 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.504977:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf540789/0x7645c8e1169f8dc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f872 expref: 9 pid: 8440 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.504994:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951068.504999:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783951068.505005:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.505016:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.505043:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951068.505099:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2410:x1870607923911424:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 195us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.505107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 104 00010000:00010000:1.0:1783951068.507592:0:9851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.507611:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.507623:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.507632:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.507660:0:9851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951068.508554:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951068.508564:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.508574:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951068.508578:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.508588:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.508662:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.508671:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008da578e/0x7645c8e1169f901c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.508694:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951068.508696:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951068.508698:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951068.509118:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1870607944927488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17579us (18691us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783951068.509129:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783951068.509273:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1783951068.509292:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1783951068.509313:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e024860c000, transno 4294967322 00000100:00100000:0.0:1783951068.509338:0:3653:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e024860f800 x1870607944927488/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783951084 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783951068.509350:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e024860f800/2, rc 0, transno 4294967323 00000100:00100000:0.0:1783951068.509355:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944927488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783951068.509874:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923911296:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 11364us (11602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.509883:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:2.0:1783951068.513551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.513638:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923911680 00000100:00100000:0.0:1783951068.513649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923911680 00000100:00100000:0.0:1783951068.513711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 245 00000100:00100000:0.0:1783951068.513721:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12500:x1870607923911680:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.513793:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951068.513823:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609000/0x7645c8e1169f9000 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f90c expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.513845:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:0.0:1783951068.513863:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951068.513894:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.513909:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.513919:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951068.514051:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee5773e6 reply state 000000000bc0988d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.514064:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.514070:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:0.0:1783951068.514073:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951068.514075:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951068.514208:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:12500:x1870607923911680:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 487us (665us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1783951068.514215:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 245 00000100:00100000:0.0:1783951068.521988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.522129:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923911808 00000100:00100000:3.0:1783951068.522168:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923911808 00000100:00100000:3.0:1783951068.522292:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 77 00000100:00100000:3.0:1783951068.522304:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2408:x1870607923911808:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783951068.522471:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783951068.522476:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1783951068 -> 1783951067 00002000:00010000:3.0:1783951068.522478:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783951067 00002000:00010000:3.0:1783951068.522480:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1783951068 -> 1783951067 00002000:00010000:3.0:1783951068.522482:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783951068.522548:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923911808:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 245us (569us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1783951068.522556:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 77 00000100:00100000:1.0:1783951068.525348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.525448:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912064 00000100:00100000:0.0:1783951068.525458:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912064 00000100:00100000:0.0:1783951068.525514:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 246 00000100:00100000:0.0:1783951068.525524:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:12500:x1870607923912064:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.525590:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.525607:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.525641:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.525678:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.525691:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 22 pid: 6526 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.525705:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944928000:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951068.525804:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951068.528925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.529024:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912192 00000100:00100000:3.0:1783951068.529034:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912192 00010000:00010000:3.0:1783951068.529076:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 23 pid: 6526 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.529120:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 105 00000100:00100000:3.0:1783951068.529178:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:2407:x1870607923912192:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951068.529196:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951068.529204:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 23 pid: 6526 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.529218:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 23 pid: 6526 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.529240:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:3.0:1783951068.529246:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.529256:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.529264:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.529282:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951068.529327:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+23:2407:x1870607923912192:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 186us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.529334:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 105 00010000:00010000:0.0:1783951068.529446:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f8fe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8fe expref: 22 pid: 6526 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.529464:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944928000:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951068.529485:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529494:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529500:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529544:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529551:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529565:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529572:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.529576:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529584:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529593:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:0.0:1783951068.529596:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783951068.529600:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.529605:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f902a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.529648:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12500:x1870607923912064:12345-192.168.202.33@tcp:55:lhsmtool_posix.0 Request processed in 4125us (4310us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783951068.529656:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 246 00000100:00100000:1.0:1783951068.533003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.533094:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912320 00000100:00100000:0.0:1783951068.533103:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912320 00000100:00100000:0.0:1783951068.533187:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:0.0:1783951068.533198:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923912320:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.533243:0:9851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.533264:0:9851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.533286:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951068.533290:0:9851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783951068.533295:0:9851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.533334:0:9851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.533350:0:9851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 8 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.533365:0:9851:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9851:1870607944928128:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951068.533454:0:9851:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951068.536210:0:9851:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9851:1870607944928128:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951068.536238:0:9851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951068.538322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.538656:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912448 00000100:00100000:3.0:1783951068.538665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912448 00010000:00010000:3.0:1783951068.538705:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 9 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.538750:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 106 00000100:00100000:3.0:1783951068.538759:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+9:2408:x1870607923912448:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951068.538800:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951068.538823:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 9 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.538837:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 9 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.538860:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f900e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f91a expref: 9 pid: 8439 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.538878:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951068.538882:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783951068.538889:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.538898:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.538938:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951068.539054:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2408:x1870607923912448:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 295us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.539062:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 106 00010000:00010000:0.0:1783951068.539189:0:9851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539198:0:9851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539219:0:9851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539235:0:9851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539243:0:9851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539250:0:9851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951068.539264:0:9851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539274:0:9851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539286:0:9851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.539294:0:9851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf11585/0x7645c8e1169f9031 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.539344:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923912320:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 6147us (6351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951068.539352:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:3.0:1783951068.545470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.545555:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912704 00000100:00100000:0.0:1783951068.545565:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912704 00000100:00100000:0.0:1783951068.545636:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 247 00000100:00100000:0.0:1783951068.545663:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:12500:x1870607923912704:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783951068.545741:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.545759:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 21 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.545770:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.545819:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 21 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.545832:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 21 pid: 11194 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.545847:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944928256:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951068.545935:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951068.548465:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944928256:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951068.548496:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.550963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.551046:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912832 00000100:00100000:3.0:1783951068.551056:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912832 00010000:00010000:3.0:1783951068.551103:0:10402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 22 pid: 11194 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.553894:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 107 00000100:00100000:3.0:1783951068.553917:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343129050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:2408:x1870607923912832:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951068.553937:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951068.553948:0:10402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 22 pid: 11194 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.553967:0:10402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 22 pid: 11194 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.553988:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f8f27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8c6 expref: 22 pid: 11194 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.554005:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:3.0:1783951068.554010:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 21 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.554021:0:10402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.554029:0:10402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.554036:0:10402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.554070:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951068.554133:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343129050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:2408:x1870607923912832:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 227us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.554181:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 107 00010000:00010000:1.0:1783951068.554283:0:11194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.554291:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.554474:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.554485:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 21 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.554499:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.554526:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 21 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.554539:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 21 pid: 10105 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951068.554553:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944928384:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951068.554601:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951068.559959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.560579:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923912960 00000100:00100000:3.0:1783951068.560588:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923912960 00010000:00010000:3.0:1783951068.560645:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 22 pid: 10105 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.560692:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 108 00000100:00100000:3.0:1783951068.560702:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:2407:x1870607923912960:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951068.560718:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951068.560725:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 22 pid: 10105 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.560739:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 22 pid: 10105 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.560760:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:3.0:1783951068.560767:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.560881:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.560890:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951068.560912:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951068.560970:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:2407:x1870607923912960:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 269us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951068.560994:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 108 00010000:00010000:1.0:1783951068.562438:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f8ff2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f905 expref: 21 pid: 10105 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951068.562461:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944928384:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951068.562483:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.562492:0:11194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.562498:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951068.562687:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1783951068.562907:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1783951068.562951:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1783951068.563058:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944928512:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783951068.563127:0:11194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951068.563355:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951068.563420:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944928512 00000100:00100000:2.0:1783951068.563428:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944928512 00000100:00100000:2.0:1783951068.563512:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783951068.563524:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11194:x1870607944928512:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783951068.563630:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11194:x1870607944928512:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.563637:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783951068.563705:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944928512:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1783951068.563844:0:11194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1783951068.563891:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944928640:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783951068.563922:0:11194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951068.564135:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951068.564287:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944928640 00000100:00100000:1.0:1783951068.564292:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944928640 00000100:00100000:1.0:1783951068.564315:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783951068.564322:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11194:x1870607944928640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783951068.564470:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:11194:x1870607944928640:12345-0@lo:1000:mdt00_004.0 Request processed in 148us (547us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1783951068.564476:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783951068.564532:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11194:1870607944928640:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1783951068.564566:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564575:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564582:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564588:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.564593:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564600:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564626:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:0.0:1783951068.564630:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951068.564634:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564640:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169f903f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564662:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564669:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564674:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564687:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.564690:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564696:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564705:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951068.564707:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951068.564714:0:11194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 24 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564725:0:11194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 24 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564734:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 24 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.564759:0:11194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 24 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.564771:0:11194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944928768:192.168.202.33@tcp:105: 00000100:00100000:0.0:1783951068.564957:0:11194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951068.568746:0:11194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11194:1870607944928768:192.168.202.33@tcp:105: 00010000:00010000:0.0:1783951068.568799:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568832:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f8f82 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568868:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568883:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568895:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568909:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568915:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568922:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568928:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5da00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.568932:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568939:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568949:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951068.568952:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951068.568955:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568967:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9046 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568977:0:11194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568983:0:11194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568988:0:11194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.568993:0:11194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951068.568996:0:11194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.569001:0:11194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.569009:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951068.569011:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951068.569014:0:11194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.569019:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9038 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.569230:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:12500:x1870607923912704:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 23567us (23767us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1783951068.569240:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 247 00000020:00080000:0.0:1783951068.569254:0:11194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783951068.569407:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951068.569411:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951068.569903:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783951068.569914:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783951068.572936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.573026:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923913088 00000100:00100000:0.0:1783951068.573036:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923913088 00000100:00100000:0.0:1783951068.573099:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:0.0:1783951068.573110:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:12499:x1870607923913088:12345-192.168.202.33@tcp:49:lfs.0 00000100:00100000:0.0:1783951068.573281:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:12499:x1870607923913088:12345-192.168.202.33@tcp:49:lfs.0 Request processed in 172us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951068.573289:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:3.0:1783951068.577253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951068.577296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.577393:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923913344 00000100:00100000:0.0:1783951068.577403:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923913344 00000100:00100000:0.0:1783951068.577464:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:0.0:1783951068.577475:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+24:12500:x1870607923913344:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783951068.577769:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783951068.577821:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1783951068.577854:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.577870:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.577882:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.577891:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.577898:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.577904:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.578042:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783951068.578166:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:12500:x1870607923913344:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 666us (907us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1783951068.578176:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00000020:00080000:0.0:1783951068.578181:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783951068.578288:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923913600 00000100:00100000:2.0:1783951068.578294:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923913600 00000100:00100000:2.0:1783951068.578337:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 248 00000100:00100000:2.0:1783951068.578346:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:12499:x1870607923913600:12345-192.168.202.33@tcp:58:lfs.0 00000040:00080000:2.0:1783951068.578467:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1783951068.578519:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:12499:x1870607923913600:12345-192.168.202.33@tcp:58:lfs.0 Request processed in 174us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.578526:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 248 00010000:00010000:1.0:1783951068.580214:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951068.580227:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.580237:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951068.580242:0:9537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.580251:0:9537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.580280:0:9537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:1.0:1783951068.580283:0:9537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951068.580288:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.580307:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f904d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.580323:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951068.580325:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951068.580326:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951068.619131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.619424:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923913728 00000100:00100000:0.0:1783951068.619434:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923913728 00000100:00100000:0.0:1783951068.619500:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 249 00000100:00100000:0.0:1783951068.619510:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+26:12502:x1870607923913728:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951068.619533:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951068.619554:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9054 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f921 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619636:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619652:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619663:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619680:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619687:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619693:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619800:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619813:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619821:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619858:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.619872:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 27 pid: 6527 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.619887:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944928896:192.168.202.33@tcp:104: 00000100:00100000:0.0:1783951068.619991:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951068.623538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951068.623657:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923913984 00000100:00100000:2.0:1783951068.623669:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923913984 00000100:00100000:2.0:1783951068.623738:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:2.0:1783951068.623748:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+28:6179:x1870607923913984:12345-192.168.202.33@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783951068.624031:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:6179:x1870607923913984:12345-192.168.202.33@tcp:35:ldlm_bl.0 Request processed in 283us (503us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1783951068.624039:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:0.0:1783951068.624856:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1870607944928896:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951068.624884:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951068.630949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951068.631247:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923914112 00000100:00100000:0.0:1783951068.631271:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923914112 00010000:00010000:0.0:1783951068.631312:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 29 pid: 6527 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951068.631356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 109 00000100:00100000:0.0:1783951068.631379:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:2408:x1870607923914112:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951068.631395:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951068.631403:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 29 pid: 6527 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.631416:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 29 pid: 6527 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.631439:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f8f74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e2 expref: 29 pid: 6527 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.631458:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951068.631464:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.631473:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.631482:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951068.631518:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951068.631582:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+28:2408:x1870607923914112:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 204us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951068.631590:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 109 00010000:00010000:1.0:1783951068.631883:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.631891:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951068.631949:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783951068.631953:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951068.631973:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.631986:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.631996:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632002:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632009:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632014:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.632019:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632036:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632049:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951068.632051:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.632055:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632061:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d600/0x7645c8e1169f905b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632073:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632079:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632085:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632089:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951068.632092:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632098:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632104:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e024782e600) 00010000:00010000:1.0:1783951068.632106:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951068.632109:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632124:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c400/0x7645c8e1169f9062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632207:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5da00/0x7645c8e1169f9054 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f921 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632222:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f921 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951068.632230:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951068.632232:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951068.632234:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:1.0:1783951068.632276:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12502:x1870607923913728:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 12768us (13154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951068.632284:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 249 00000100:00100000:0.0:1783951068.768623:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944929024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951068.768698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951068.768913:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929024 00000100:00100000:2.0:1783951068.768921:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929024 00000100:00100000:2.0:1783951068.768980:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783951068.768989:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944929024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951068.769021:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783951068.769080:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944929024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951068.769089:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783951068.769161:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944929024:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783951068.769225:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951069.280564:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944929152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951069.280650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951069.280731:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929152 00000100:00100000:3.0:1783951069.280739:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929152 00000100:00100000:3.0:1783951069.280796:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783951069.280806:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607944929152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951069.280829:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783951069.280867:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607944929152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951069.280872:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783951069.280908:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944929152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783951069.285664:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951069.411966:0:14765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951069.411976:0:14765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951069.412012:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783951069.412019:0:14765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783951069.602359:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951069.602369:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951069.602421:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783951069.602429:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783951069.602566:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944929280:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951069.602694:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951069.615259:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13803:1870607944929280:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951069.626042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951069.626119:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923914240 00000100:00100000:0.0:1783951069.626128:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923914240 00000100:00100000:2.0:1783951069.626321:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 250 00000100:00100000:2.0:1783951069.626333:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12515:x1870607923914240:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951069.626371:0:6527:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951069.626494:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12515:x1870607923914240:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 163us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951069.626501:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 250 00000100:00100000:0.0:1783951069.642279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951069.644796:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923914496 00000100:00100000:1.0:1783951069.644810:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923914496 00000100:00100000:1.0:1783951069.644874:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 251 00000100:00100000:1.0:1783951069.644885:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+27:12515:x1870607923914496:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951069.644908:0:10105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951069.644930:0:10105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f9070 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f928 expref: -99 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951069.645062:0:10105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9077 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951069.645076:0:10105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951069.645090:0:10105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951069.645102:0:10105:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783951069.645222:0:10105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f9070 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f928 expref: 30 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951069.645237:0:10105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f928 expref: 29 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951069.645245:0:10105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951069.645248:0:10105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951069.645252:0:10105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67600, rc 0) 00000100:00100000:1.0:1783951069.645314:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:12515:x1870607923914496:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 430us (3043us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1783951069.645322:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 251 00000100:00100000:3.0:1783951069.651447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951069.661486:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923914752 00000100:00100000:0.0:1783951069.661500:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923914752 00000100:00100000:0.0:1783951069.661786:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 252 00000100:00100000:0.0:1783951069.661797:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:12515:x1870607923914752:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783951069.661878:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.661896:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.661907:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662073:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662080:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662086:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662092:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951069.662096:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662102:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662124:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951069.662127:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951069.662133:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.662190:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d400/0x7645c8e1169f9085 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951069.662311:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:12515:x1870607923914752:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 515us (10875us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783951069.662321:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 252 00000040:00080000:2.0:1783951069.662703:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951069.662709:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951069.663233:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783951069.663244:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951069.667792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951069.667872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951069.667901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923914880 00000100:00100000:0.0:1783951069.667911:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923914880 00000100:00100000:0.0:1783951069.667968:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951069.667978:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:2407:x1870607923914880:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951069.667993:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951069.668017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9077 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f928 expref: 30 pid: 10105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951069.668035:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:0.0:1783951069.668041:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951069.668087:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:2407:x1870607923914880:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951069.668095:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951069.668116:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923915136 00000100:00100000:0.0:1783951069.668127:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923915136 00000100:00100000:0.0:1783951069.668177:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:0.0:1783951069.668185:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+29:12515:x1870607923915136:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951069.668368:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:12515:x1870607923915136:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 183us (495us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783951069.668375:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00010000:00010000:3.0:1783951070.305646:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951071.328334:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951071.328994:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951071.329025:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944929536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951071.329118:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951071.329230:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929536 00000100:00100000:3.0:1783951071.329241:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929536 00000100:00100000:3.0:1783951071.329311:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783951071.329322:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944929536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951071.329383:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783951071.329447:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1870607944929536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951071.329455:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783951071.329528:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944929536:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783951071.329987:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951071.330089:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951071.330106:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944929408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951071.330177:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951071.331232:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944929664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951071.331287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951071.331348:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929664 00000100:00100000:3.0:1783951071.331357:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929664 00000100:00100000:3.0:1783951071.331404:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783951071.331413:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944929664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951071.331469:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783951071.331519:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944929664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951071.331527:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783951071.331573:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944929664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951071.331762:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929408 00000100:00100000:2.0:1783951071.331767:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929408 00000100:00100000:2.0:1783951071.331824:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783951071.331833:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944929408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951071.331851:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783951071.331897:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944929408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.331904:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783951071.331943:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944929408:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783951071.332070:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951071.332700:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944929792:0@lo:400:kworker.0 00000100:00100000:3.0:1783951071.332774:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951071.332857:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929792 00000100:00100000:2.0:1783951071.332863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929792 00000100:00100000:2.0:1783951071.332909:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1783951071.332919:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951071.333265:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944929920:0@lo:400:kworker.0 00000100:00100000:0.0:1783951071.333306:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951071.333332:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951071.333338:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944930048:0@lo:400:kworker.0 00000100:00100000:0.0:1783951071.333361:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951071.333390:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944930176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951071.333425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951071.334973:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944929792:12345-0@lo:400:kworker.0 Request processed in 2046us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.334994:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1783951071.335068:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944929920 00000100:00100000:2.0:1783951071.335077:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944929920 00000100:00100000:2.0:1783951071.335122:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930048 00000100:00100000:2.0:1783951071.335126:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930048 00000100:00100000:2.0:1783951071.335163:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783951071.335171:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944929920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.335248:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944929920:12345-0@lo:400:kworker.0 Request processed in 77us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.335255:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783951071.335268:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1783951071.335275:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944930048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.335300:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944930048:12345-0@lo:400:kworker.0 Request processed in 26us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.335305:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1783951071.335355:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944930048:0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.335369:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944929920:0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.335540:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930176 00000100:00100000:2.0:1783951071.335545:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930176 00000100:00100000:2.0:1783951071.335576:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783951071.335583:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944930176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.335630:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944930176:12345-0@lo:400:kworker.0 Request processed in 47us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.335636:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783951071.335662:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944930176:0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.338033:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951071.338065:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944930304:0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.338180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951071.338277:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944930688:0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.338320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951071.338359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930688 00000100:00100000:1.0:1783951071.338368:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930688 00000100:00100000:1.0:1783951071.338449:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783951071.338474:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.338537:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1870607944930688:12345-0@lo:400:kworker.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951071.338546:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783951071.338687:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944930688:0@lo:400:kworker.0 00000100:00080000:1.0:1783951071.338725:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951071.338871:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951071.338880:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944930816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.338906:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951071.338934:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930304 00000100:00100000:1.0:1783951071.338938:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930304 00000100:00100000:1.0:1783951071.338966:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930816 00000100:00100000:1.0:1783951071.338969:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930816 00000100:00100000:1.0:1783951071.338988:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783951071.338995:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.339032:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944930304:12345-0@lo:400:kworker.0 Request processed in 38us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951071.339039:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783951071.339051:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783951071.339056:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944930816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.339080:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944930816:12345-0@lo:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951071.339085:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783951071.339124:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944930816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951071.339133:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944930304:0@lo:400:kworker.0 00000100:00080000:1.0:1783951071.339172:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951071.339507:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944930432:0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.339545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951071.339565:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944930944:0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.339585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951071.339618:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951071.339625:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944930560:0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.339651:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951071.339676:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930432 00000100:00100000:2.0:1783951071.339680:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930432 00000100:00100000:2.0:1783951071.339710:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930944 00000100:00100000:2.0:1783951071.339724:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930944 00000100:00100000:2.0:1783951071.339923:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1783951071.339933:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944930432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.339979:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944930432:12345-0@lo:400:kworker.0 Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.339986:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1783951071.340001:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783951071.340007:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944930944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.340035:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944930944:12345-0@lo:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.340041:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783951071.340062:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944930560 00000100:00100000:2.0:1783951071.340066:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944930560 00000100:00100000:2.0:1783951071.340103:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783951071.340109:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e90ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944930560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951071.340161:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e90ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944930560:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951071.340177:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1783951071.340354:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951071.340359:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951071.340497:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944930560:0@lo:400:kworker.0 00010000:00080000:2.0:1783951071.340512:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024818a300 x1870607944930432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951071.340524:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944930432:0@lo:400:kworker.0 00010000:00080000:2.0:1783951071.340535:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024818ad80 x1870607944930944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951071.340544:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944930944:0@lo:400:kworker.0 00000100:00100000:3.0:1783951071.342286:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944929792:0@lo:400:kworker.0 00000040:00080000:0.0:1783951071.547461:0:14816:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783951071.547474:0:14816:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783951071.547514:0:14816:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783951071.547522:0:14816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951071.732718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951071.732974:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923915392 00000100:00100000:2.0:1783951071.732987:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923915392 00000100:00100000:2.0:1783951071.733087:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 253 00000100:00100000:2.0:1783951071.733099:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+30:12535:x1870607923915392:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951071.733135:0:11194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951071.733186:0:11194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f908c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f92f expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951071.733353:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f9093 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951071.733372:0:11194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f9093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951071.733390:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f9093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951071.733428:0:11194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783951071.733582:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f908c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f92f expref: 33 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951071.733743:0:11194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f9093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f92f expref: 32 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951071.733764:0:11194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:2.0:1783951071.733768:0:11194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783951071.733772:0:11194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609c00, rc 0) 00000100:00100000:2.0:1783951071.733856:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:12535:x1870607923915392:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 758us (1155us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783951071.733867:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 253 00000100:00080000:3.0:1783951071.733946:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951071.740865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951071.748112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923915520 00000100:00100000:1.0:1783951071.748133:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923915520 00000100:00100000:1.0:1783951071.748234:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 254 00000100:00100000:1.0:1783951071.748246:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:12535:x1870607923915520:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:1.0:1783951071.748333:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748355:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748369:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748417:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748423:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748431:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748437:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951071.748442:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748450:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748485:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951071.748488:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951071.748494:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.748500:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169f90a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951071.748726:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:12535:x1870607923915520:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 480us (7872us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951071.748735:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 254 00000100:00100000:0.0:1783951071.806138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951071.806454:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923915648 00000100:00100000:1.0:1783951071.806467:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923915648 00000100:00100000:1.0:1783951071.806610:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:1.0:1783951071.806622:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923915648:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:1.0:1783951071.806648:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951071.806673:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3870d4b/0x7645c8e1169f90a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f936 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951071.806701:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a54eedb, atime: 0x6a54eedb, ctime: 0x6a54eedb, blocks: 0x8 00010000:00010000:1.0:1783951071.806725:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1783951071.806729:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951071.806738:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3870d4b/0x7645c8e1169f90a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f936 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.806778:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3870d4b/0x7645c8e1169f90a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f936 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951071.806826:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951071.806900:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923915648:12345-192.168.202.33@tcp:101:cat.0 Request processed in 279us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951071.806908:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00080000:3.0:1783951071.807013:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951071.809364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951071.809434:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923915776 00000100:00100000:0.0:1783951071.809447:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923915776 00002000:00100000:0.0:1783951071.809513:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9e024856b100 x1870607923915776/t0(0) o3->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:87/0 lens 488/0 e 0 to 0 dl 1783951082 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783951071.809545:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024856b100 with x1870607923915776 ext(0->4095) 00002000:00010000:0.0:1783951071.809552:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e024856b100 00000100:00100000:0.0:1783951071.809630:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:0.0:1783951071.809641:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923915776:12345-192.168.202.33@tcp:3:cat.0 00000100:00100000:0.0:1783951071.809852:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923915776:12345-192.168.202.33@tcp:3:cat.0 Request processed in 212us (497us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783951071.809861:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00002000:00100000:0.0:1783951071.809869:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9e024856b100 x1870607923915776/t0(0) o3->75392fba-af18-4ae6-9b8a-6f1db7dcbeed@192.168.202.33@tcp:87/0 lens 488/4536 e 0 to 0 dl 1783951082 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783951071.809877:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e024856b100 with x1870607923915776 ext(0->4095) 00002000:00010000:0.0:1783951071.809880:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e024856b100 00010000:00010000:0.0:1783951072.353895:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951073.041335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951073.041588:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916032 00000100:00100000:0.0:1783951073.041601:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916032 00000100:00100000:0.0:1783951073.041697:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916544 00000100:00100000:0.0:1783951073.041700:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916544 00000100:00100000:0.0:1783951073.041717:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916160 00000100:00100000:0.0:1783951073.041720:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916160 00000100:00100000:0.0:1783951073.042053:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916672 00000100:00100000:0.0:1783951073.042056:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916672 00000100:00100000:0.0:1783951073.042076:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 332 00000100:00100000:0.0:1783951073.042087:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:2409:x1870607923916032:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951073.042275:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 333 00000100:00100000:1.0:1783951073.042287:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923916544:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951073.042395:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923916544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 111us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951073.042415:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 333 00000100:00100000:1.0:1783951073.042439:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 334 00000100:00100000:1.0:1783951073.042446:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923916160:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951073.042473:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923916160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951073.042480:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 334 00000100:00100000:1.0:1783951073.042492:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 335 00000100:00100000:1.0:1783951073.042499:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923916672:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951073.042535:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923916672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 36us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951073.042542:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 335 00000100:00100000:0.0:1783951073.043253:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+32:2409:x1870607923916032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1162us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951073.043263:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 332 00000100:00100000:0.0:1783951073.043297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923915904 00000100:00100000:0.0:1783951073.043304:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923915904 00000100:00100000:0.0:1783951073.043345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 394 00000100:00100000:0.0:1783951073.043351:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923915904:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951073.043375:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923915904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951073.043381:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 394 00000100:00100000:0.0:1783951073.043946:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916288 00000100:00100000:0.0:1783951073.043953:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916288 00000100:00100000:0.0:1783951073.044035:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916416 00000100:00100000:0.0:1783951073.044039:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916416 00000100:00100000:1.0:1783951073.048595:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:1.0:1783951073.048626:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923916288:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951073.048780:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923916288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 167us (7397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951073.048789:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:1.0:1783951073.048821:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:1.0:1783951073.048831:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923916416:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951073.048864:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+8:2409:x1870607923916416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 35us (7366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951073.048870:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00080000:1.0:1783951073.049391:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951073.049398:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951073.049402:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951073.049415:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951073.376635:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783951073.381322:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1783951073.385946:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944931072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951073.386063:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951073.386713:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931072 00000100:00100000:0.0:1783951073.386726:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931072 00000100:00100000:0.0:1783951073.386807:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783951073.386820:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944931072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951073.386874:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783951073.404435:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944931072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 17597us (18353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951073.404456:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783951073.409066:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944931072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951073.888385:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944931200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951073.888490:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951073.888659:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931200 00000100:00100000:2.0:1783951073.888670:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931200 00000100:00100000:2.0:1783951073.888776:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783951073.888788:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944931200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951073.888836:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951073.888898:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944931200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951073.888906:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1783951073.889421:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951073.889479:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944931200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951074.400376:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944931328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951074.400516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951074.400598:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931328 00000100:00100000:3.0:1783951074.400606:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931328 00000100:00100000:3.0:1783951074.400669:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783951074.400679:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944931328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951074.400708:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951074.400767:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944931328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951074.400775:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783951074.400830:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1783951074.400836:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1783951074.400859:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0248334700, transno 4294967311 00000100:00100000:3.0:1783951074.400878:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944931328:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783951074.404264:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1783951074.404308:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e03433b8900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1783951074.404315:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0351e6bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e03432b7cc0 00000020:00080000:0.0:1783951074.404318:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e0351e6ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e0248607a00 00000020:00080000:0.0:1783951074.404340:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1783951074.404370:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951074.404386:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951074.404395:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951074.404403:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5de00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951074.404410:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951074.404420:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951074.404445:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e0347f05400) 00010000:00010000:0.0:1783951074.404449:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951074.404455:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951074.404461:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f9023 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951074.405215:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951074.411020:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783951074.411440:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783951074.411550:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1783951074.431938:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1783951074.431965:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000040:00080000:0.0:1783951075.424888:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783951075.425299:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951075.809352:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783951075.809366:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951075.809512:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783951075.809519:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783951076.448464:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944931584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448530:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448587:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944932096:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448609:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448631:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944932608:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448651:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448687:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1783951076.448693:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944931456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448734:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448756:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944931968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448781:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448799:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944932480:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448834:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448852:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944932992:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448872:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448897:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944931840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448932:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448951:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944932352:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.448971:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.448985:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944932864:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.449023:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783951076.449029:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944931712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.449066:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944932224:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951076.449100:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944932736:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951076.449139:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951076.449177:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931584 00000100:00100000:1.0:1783951076.449183:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931584 00000100:00100000:1.0:1783951076.449225:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932096 00000100:00100000:1.0:1783951076.449228:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932096 00000100:00100000:1.0:1783951076.449247:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932608 00000100:00100000:1.0:1783951076.449250:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932608 00000100:00100000:1.0:1783951076.449261:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931840 00000100:00100000:1.0:1783951076.449263:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931840 00000100:00100000:1.0:1783951076.449271:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932224 00000100:00100000:1.0:1783951076.449273:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932224 00000100:00100000:1.0:1783951076.449284:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932736 00000100:00100000:1.0:1783951076.449286:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932736 00000100:00100000:1.0:1783951076.449301:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783951076.449309:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449358:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944931584:12345-0@lo:400:kworker.0 Request processed in 48us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449365:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783951076.449382:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1783951076.449388:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944932096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449415:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944932096:12345-0@lo:400:kworker.0 Request processed in 27us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449421:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1783951076.449432:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783951076.449438:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944932608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449462:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944932608:12345-0@lo:400:kworker.0 Request processed in 25us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449468:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783951076.449478:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783951076.449483:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944931840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449510:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944931840:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449521:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783951076.449534:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783951076.449540:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944932224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449566:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944932224:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449572:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783951076.449583:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783951076.449589:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944932736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449614:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944932736:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449619:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783951076.449643:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931456 00000100:00100000:1.0:1783951076.449646:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931456 00000100:00100000:1.0:1783951076.449669:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1783951076.449674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449715:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1065061-5fe9-438e-843f-5f70939080ee+24:3655:x1870607944931456:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449721:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1783951076.449752:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931968 00000100:00100000:1.0:1783951076.449756:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931968 00000100:00100000:1.0:1783951076.449775:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944931712 00000100:00100000:1.0:1783951076.449778:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944931712 00000100:00100000:1.0:1783951076.449788:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783951076.449794:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944931968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449824:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944931968:12345-0@lo:400:kworker.0 Request processed in 30us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449839:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783951076.449851:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783951076.449857:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944931712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.449884:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944931712:12345-0@lo:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.449890:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783951076.449908:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932480 00000100:00100000:1.0:1783951076.449911:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932480 00000100:00100000:1.0:1783951076.449930:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932992 00000100:00100000:1.0:1783951076.449933:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932992 00000100:00100000:1.0:1783951076.449944:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932352 00000100:00100000:1.0:1783951076.449947:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932352 00000100:00100000:1.0:1783951076.449956:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944932864 00000100:00100000:1.0:1783951076.449959:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944932864 00000100:00100000:1.0:1783951076.449971:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783951076.449976:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944932480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450006:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944932480:12345-0@lo:400:kworker.0 Request processed in 29us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.450012:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783951076.450022:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783951076.450028:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450054:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944932992:12345-0@lo:400:kworker.0 Request processed in 26us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.450059:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783951076.450070:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951076.450075:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944932352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450111:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944932352:12345-0@lo:400:kworker.0 Request processed in 36us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.450117:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783951076.450127:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783951076.450132:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944932864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450183:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944932864:12345-0@lo:400:kworker.0 Request processed in 51us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.450189:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783951076.450240:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944931712:0@lo:400:kworker.0 00010000:00080000:1.0:1783951076.450254:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b67800 x1870607944932224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951076.450264:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944932224:0@lo:400:kworker.0 00010000:00080000:1.0:1783951076.450274:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b64700 x1870607944932736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951076.450282:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944932736:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450292:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944931840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450299:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944932352:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450308:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944932864:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450349:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944931456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450357:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944931968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450366:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944932480:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450383:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1783951076.450388:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e024860f800, transno 4294967323 00000004:00080000:1.0:1783951076.450399:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1783951076.450418:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944932992:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450429:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944931584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450438:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944932096:0@lo:400:kworker.0 00000100:00100000:1.0:1783951076.450449:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944932608:0@lo:400:kworker.0 00000100:00100000:3.0:1783951076.451504:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951076.451517:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944933120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951076.451558:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951076.451592:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933120 00000100:00100000:3.0:1783951076.451598:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933120 00000100:00100000:3.0:1783951076.451627:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783951076.451634:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944933120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951076.451657:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783951076.451694:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944933120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951076.451713:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783951076.451757:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944933120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951076.452019:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944933248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951076.452047:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951076.452082:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951076.452086:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951076.452090:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951076.452092:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951076.452123:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933248 00000100:00100000:0.0:1783951076.452127:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933248 00000100:00100000:0.0:1783951076.452165:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783951076.452172:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944933248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951076.452182:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783951076.452223:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944933248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951076.452230:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783951076.452264:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944933248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951076.454220:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944933376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951076.454281:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951076.454401:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933376 00000100:00100000:2.0:1783951076.454413:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933376 00000100:00100000:2.0:1783951076.454484:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783951076.454500:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944933376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951076.454553:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783951076.454666:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944933376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951076.454675:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783951076.454698:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944933376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951076.749457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951076.749569:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916800 00000100:00100000:2.0:1783951076.749579:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916800 00000100:00100000:2.0:1783951076.749665:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 255 00000100:00100000:2.0:1783951076.749676:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:12179:x1870607923916800:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783951076.749802:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:12179:x1870607923916800:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 128us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951076.749811:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 255 00000100:00080000:0.0:1783951076.749893:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951076.763669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951076.763777:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923916928 00000100:00100000:3.0:1783951076.763788:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923916928 00000100:00080000:0.0:1783951076.763943:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951076.763991:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 256 00000100:00100000:1.0:1783951076.764003:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:12179:x1870607923916928:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783951076.764108:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:12179:x1870607923916928:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 108us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951076.764116:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 256 00000100:00100000:1.0:1783951076.772193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951076.772753:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917184 00000100:00100000:0.0:1783951076.772763:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917184 00000100:00100000:0.0:1783951076.772829:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:0.0:1783951076.772839:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:12179:x1870607923917184:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951076.773393:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:12179:x1870607923917184:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 554us (1208us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1783951076.773403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:2.0:1783951077.074677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951077.079755:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917312 00000100:00100000:0.0:1783951077.079787:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917312 00000100:00100000:0.0:1783951077.079951:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 257 00000100:00100000:0.0:1783951077.079965:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+5:12992:x1870607923917312:12345-192.168.202.33@tcp:101:lsof.0 00010000:00010000:0.0:1783951077.079985:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951077.080009:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f90af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f93d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951077.080076:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f90b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951077.080090:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f90b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951077.080102:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f90b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951077.080180:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951077.080184:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951077.080209:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f90b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951077.080233:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5de00/0x7645c8e1169f90af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f93d expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951077.080252:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f90b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f93d expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951077.080261:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:0.0:1783951077.080263:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951077.080267:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d200, rc 0) 00000100:00100000:0.0:1783951077.080341:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7ffa451-5324-4858-a00e-bb5627316d28+6:12992:x1870607923917312:12345-192.168.202.33@tcp:101:lsof.0 Request processed in 379us (5673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951077.080348:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 257 00000100:00080000:2.0:1783951077.084742:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783951077.472342:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951078.150263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951078.150309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951078.150356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951078.150607:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917696 00000100:00100000:0.0:1783951078.150616:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917696 00000100:00100000:0.0:1783951078.150678:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 342 00000100:00100000:0.0:1783951078.150699:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923917696:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951078.150924:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917952 00000100:00100000:2.0:1783951078.150929:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917952 00000100:00100000:2.0:1783951078.150963:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1783951078.150971:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923917952:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951078.151804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917440 00000100:00100000:3.0:1783951078.151810:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917440 00000100:00100000:3.0:1783951078.151848:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 396 00000100:00100000:3.0:1783951078.151856:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923917440:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951078.152675:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923917696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1983us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951078.152697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 342 00000100:00080000:1.0:1783951078.153119:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951078.153126:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951078.153732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951078.153772:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951078.153826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951078.153851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951078.153873:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917824 00000100:00100000:1.0:1783951078.153879:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917824 00000100:00100000:1.0:1783951078.153920:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:1.0:1783951078.153928:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923917824:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951078.153981:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2409:x1870607923917824:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951078.153988:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:1.0:1783951078.154011:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918208 00000100:00100000:1.0:1783951078.154014:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918208 00000100:00100000:1.0:1783951078.154041:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923917568 00000100:00100000:1.0:1783951078.154044:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923917568 00000100:00100000:1.0:1783951078.154059:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918080 00000100:00100000:1.0:1783951078.154061:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918080 00000100:00100000:1.0:1783951078.154074:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 343 00000100:00100000:1.0:1783951078.154080:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923918208:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951078.154107:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2409:x1870607923918208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951078.154113:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 343 00000100:00100000:1.0:1783951078.154125:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 344 00000100:00100000:1.0:1783951078.154172:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:2409:x1870607923917568:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951078.154206:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:2409:x1870607923917568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951078.154212:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 344 00000100:00100000:1.0:1783951078.154225:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 345 00000100:00100000:1.0:1783951078.154240:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2409:x1870607923918080:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951078.154265:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2409:x1870607923918080:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951078.154270:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 345 00000100:00080000:1.0:1783951078.154285:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951078.154289:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951078.154291:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951078.155220:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2409:x1870607923917952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4243us (4855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951078.155244:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:3.0:1783951078.156345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923917440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4469us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951078.156359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 396 00000100:00100000:3.0:1783951078.496673:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944933504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951078.496789:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951078.496921:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951078.497071:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933504 00000100:00100000:1.0:1783951078.497081:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933504 00000100:00100000:1.0:1783951078.497171:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783951078.497182:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944933504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951078.497231:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783951078.497300:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944933504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951078.497308:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783951078.497465:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944933504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951079.009927:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944933632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951079.010005:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951079.010135:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933632 00000100:00100000:0.0:1783951079.010165:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933632 00000100:00100000:0.0:1783951079.010226:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951079.010237:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944933632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951079.010273:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951079.010321:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944933632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951079.010329:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951079.010392:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944933632:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783951079.010786:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951079.522403:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944933760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951079.522502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951079.523288:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933760 00000100:00100000:2.0:1783951079.523302:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933760 00000100:00100000:2.0:1783951079.523393:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783951079.523406:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944933760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951079.523441:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951079.523507:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944933760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951079.523516:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783951079.523756:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944933760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783951079.523931:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951079.524111:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951079.801005:0:15014:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:57:58 (1783951078) 00000001:00080000:3.0:1783951080.551416:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1783951080.551442:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783951080.551482:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783951080.551509:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783951080.553322:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951081.568799:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951081.570754:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944934144:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.570873:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951081.570946:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944934656:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.570977:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951081.571011:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944935168:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571057:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951081.571088:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783951081.571096:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944934016:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571121:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951081.571137:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944934528:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571181:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951081.571205:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944935040:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571226:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951081.571304:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934656 00000100:00100000:0.0:1783951081.571313:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934656 00000100:00100000:0.0:1783951081.571373:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935168 00000100:00100000:0.0:1783951081.571376:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935168 00000100:00100000:0.0:1783951081.571392:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934016 00000100:00100000:0.0:1783951081.571395:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934016 00000100:00100000:0.0:1783951081.571408:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934528 00000100:00100000:0.0:1783951081.571410:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934528 00000100:00100000:0.0:1783951081.571422:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935040 00000100:00100000:0.0:1783951081.571424:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935040 00000100:00100000:0.0:1783951081.571443:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783951081.571452:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944934656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571527:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944934656:12345-0@lo:400:kworker.0 Request processed in 74us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951081.571535:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783951081.571556:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1783951081.571564:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944935168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571593:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944935168:12345-0@lo:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951081.571611:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1783951081.571625:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1783951081.571631:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944934016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571674:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944934016:12345-0@lo:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951081.571680:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1783951081.571692:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783951081.571698:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944934528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571726:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944934528:12345-0@lo:400:kworker.0 Request processed in 29us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951081.571732:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783951081.571744:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1783951081.571751:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944935040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571776:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944935040:12345-0@lo:400:kworker.0 Request processed in 26us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951081.571783:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:0.0:1783951081.571820:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951081.571825:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951081.571858:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944934016:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571868:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944934528:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571876:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944935040:0@lo:400:kworker.0 00010000:00080000:0.0:1783951081.571889:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247b65880 x1870607944934656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951081.571912:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944934656:0@lo:400:kworker.0 00010000:00080000:0.0:1783951081.571924:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024818ad80 x1870607944935168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951081.571933:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944935168:0@lo:400:kworker.0 00000100:00100000:0.0:1783951081.571960:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951081.571969:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944935552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951081.571998:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.574977:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944933888:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575120:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944934400:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575168:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575190:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944934912:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575211:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575228:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944935424:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575280:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1783951081.575287:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944934272:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575311:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575327:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944934784:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575345:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575360:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944935296:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575390:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944935808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951081.575439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575466:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951081.575473:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944935680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951081.575496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951081.575541:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934144 00000100:00100000:2.0:1783951081.575550:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934144 00000100:00100000:2.0:1783951081.575591:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934400 00000100:00100000:2.0:1783951081.575593:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934400 00000100:00100000:2.0:1783951081.575603:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935808 00000100:00100000:2.0:1783951081.575605:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935808 00000100:00100000:2.0:1783951081.575618:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783951081.575627:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944934144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575698:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944934144:12345-0@lo:400:kworker.0 Request processed in 70us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.575706:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783951081.575724:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783951081.575730:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944934400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.575758:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944934400:12345-0@lo:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.575773:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783951081.575783:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783951081.575788:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349450450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944935808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951081.575820:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783951081.575849:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349450450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944935808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.575855:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783951081.576281:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935552 00000100:00100000:2.0:1783951081.576288:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935552 00000100:00100000:2.0:1783951081.576322:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935680 00000100:00100000:2.0:1783951081.576324:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935680 00000100:00100000:2.0:1783951081.576338:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783951081.576343:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944935552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951081.576367:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783951081.576400:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944935552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576405:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783951081.576415:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783951081.576420:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944935680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951081.576428:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783951081.576451:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944935680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576457:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783951081.576549:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944933888 00000100:00100000:2.0:1783951081.576552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944933888 00000100:00100000:2.0:1783951081.576579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1783951081.576592:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944933888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.576619:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944933888:12345-0@lo:400:kworker.0 Request processed in 28us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576624:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1783951081.576652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934912 00000100:00100000:2.0:1783951081.576668:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934912 00000100:00100000:2.0:1783951081.576691:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935424 00000100:00100000:2.0:1783951081.576694:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935424 00000100:00100000:2.0:1783951081.576702:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934784 00000100:00100000:2.0:1783951081.576705:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934784 00000100:00100000:2.0:1783951081.576715:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935296 00000100:00100000:2.0:1783951081.576718:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935296 00000100:00100000:2.0:1783951081.576730:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783951081.576735:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944934912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.576764:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944934912:12345-0@lo:400:kworker.0 Request processed in 28us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576770:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783951081.576779:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783951081.576784:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.576804:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944935424:12345-0@lo:400:kworker.0 Request processed in 20us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576809:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783951081.576817:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783951081.576822:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944934784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.576841:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944934784:12345-0@lo:400:kworker.0 Request processed in 19us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576846:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783951081.576861:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783951081.576866:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944935296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.576887:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944935296:12345-0@lo:400:kworker.0 Request processed in 22us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.576893:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783951081.576967:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944935680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951081.577000:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944934784:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577010:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944935296:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577023:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944935808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951081.577031:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944933888:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577041:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944934400:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577049:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944934912:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577057:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944935424:0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577089:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944934272 00000100:00100000:2.0:1783951081.577093:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944934272 00000100:00100000:2.0:1783951081.577117:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783951081.577123:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944934272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951081.577180:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944934272:12345-0@lo:400:kworker.0 Request processed in 57us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951081.577187:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783951081.577208:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944934272:0@lo:400:kworker.0 00000100:00100000:1.0:1783951081.577935:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944935552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951081.577953:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944934144:0@lo:400:kworker.0 00000100:00080000:0.0:1783951081.579035:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951081.579045:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783951082.592509:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951083.265698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.265748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.265798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.265829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.265848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.265864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.265885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951083.265969:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918848 00000100:00100000:2.0:1783951083.265983:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918848 00000100:00100000:2.0:1783951083.266050:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918720 00000100:00100000:2.0:1783951083.266054:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918720 00000100:00100000:2.0:1783951083.266077:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:2.0:1783951083.266087:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2410:x1870607923918848:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951083.266207:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2410:x1870607923918848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 120us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.266215:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:2.0:1783951083.266232:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:2.0:1783951083.266239:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923918720:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951083.266263:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923918720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.266269:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:2.0:1783951083.266290:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918592 00000100:00100000:2.0:1783951083.266293:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918592 00000100:00100000:2.0:1783951083.266315:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923919104 00000100:00100000:2.0:1783951083.266317:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923919104 00000100:00100000:2.0:1783951083.266329:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918464 00000100:00100000:2.0:1783951083.266331:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918464 00000100:00100000:2.0:1783951083.266344:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918976 00000100:00100000:2.0:1783951083.266346:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918976 00000100:00100000:2.0:1783951083.266359:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 352 00000100:00100000:2.0:1783951083.266364:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923918592:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951083.266390:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2410:x1870607923918592:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.266396:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 352 00000100:00100000:2.0:1783951083.266407:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 353 00000100:00100000:2.0:1783951083.266419:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923919104:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951083.266443:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2410:x1870607923919104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.266449:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 353 00000100:00100000:2.0:1783951083.266461:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 354 00000100:00100000:2.0:1783951083.266467:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2410:x1870607923918464:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951083.266489:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:2410:x1870607923918464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 22us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.266495:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 354 00000100:00100000:2.0:1783951083.266507:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 355 00000100:00100000:2.0:1783951083.266514:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2410:x1870607923918976:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951083.266537:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+6:2410:x1870607923918976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.266542:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 355 00000100:00080000:1.0:1783951083.266822:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951083.266827:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951083.266829:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951083.266831:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951083.267021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923918336 00000100:00100000:3.0:1783951083.267026:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923918336 00000100:00100000:3.0:1783951083.267066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 398 00000100:00100000:3.0:1783951083.267074:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923918336:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951083.267114:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2410:x1870607923918336:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 41us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951083.267120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 398 00000100:00100000:1.0:1783951083.357502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951083.357879:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923919360 00000100:00100000:0.0:1783951083.357889:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923919360 00000100:00100000:0.0:1783951083.358041:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:0.0:1783951083.358053:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+18:13215:x1870607923919360:12345-192.168.202.33@tcp:35:umount.0 00000100:00100000:0.0:1783951083.358871:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:13215:x1870607923919360:12345-192.168.202.33@tcp:35:umount.0 Request processed in 816us (1374us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1783951083.358882:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:1.0:1783951083.361597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951083.361681:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923919616 00000100:00100000:2.0:1783951083.361690:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923919616 00000100:00100000:2.0:1783951083.361749:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:2.0:1783951083.361760:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+19:13215:x1870607923919616:12345-192.168.202.33@tcp:35:umount.0 00000100:00100000:2.0:1783951083.362105:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:13215:x1870607923919616:12345-192.168.202.33@tcp:35:umount.0 Request processed in 347us (517us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783951083.362113:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:1.0:1783951083.366771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951083.366890:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923919872 00000100:00100000:2.0:1783951083.366902:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923919872 00000100:00100000:2.0:1783951083.366964:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:2.0:1783951083.366989:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034941e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+20:13215:x1870607923919872:12345-192.168.202.33@tcp:35:umount.0 00000100:00100000:2.0:1783951083.367316:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034941e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:13215:x1870607923919872:12345-192.168.202.33@tcp:35:umount.0 Request processed in 327us (557us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1783951083.367324:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:1.0:1783951083.370578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951083.370690:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923920128 00000100:00100000:2.0:1783951083.370703:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923920128 00000100:00100000:2.0:1783951083.370775:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:2.0:1783951083.370787:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:13215:x1870607923920128:12345-192.168.202.33@tcp:35:umount.0 00000100:00100000:2.0:1783951083.371204:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:13215:x1870607923920128:12345-192.168.202.33@tcp:35:umount.0 Request processed in 418us (636us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1783951083.371213:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1783951083.374805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.374834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.374851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.374942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.374977:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923920896 00000100:00100000:1.0:1783951083.374987:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923920896 00000100:00100000:1.0:1783951083.375036:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 80 00000100:00100000:1.0:1783951083.375044:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+7:2406:x1870607923920896:12345-192.168.202.33@tcp:9:umount.0 00000020:00000080:1.0:1783951083.375080:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f861a 00000020:00010000:1.0:1783951083.375090:0:8439:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e0248101000: total 0 00000100:00080000:1.0:1783951083.375094:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9e0248106000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951083.375138:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783951083.375338:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923920256 00000100:00100000:0.0:1783951083.375342:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923920256 00000100:00100000:0.0:1783951083.375376:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923920512 00000100:00100000:0.0:1783951083.375378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923920512 00000100:00100000:0.0:1783951083.375384:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923920384 00000100:00100000:0.0:1783951083.375385:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923920384 00000100:00100000:0.0:1783951083.375394:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951083.375399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+15:2409:x1870607923920256:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951083.375412:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951083.375448:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3600/0x7645c8e1169f808d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f490 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951083.375469:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951083.375530:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+14:2409:x1870607923920256:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 131us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951083.375537:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951083.375551:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951083.375555:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+13:2409:x1870607923920512:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951083.375561:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951083.375578:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949000/0x7645c8e1169f82e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f569 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951083.375586:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951083.375598:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:2409:x1870607923920512:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 43us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951083.375602:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951083.375610:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783951083.375613:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:2409:x1870607923920384:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951083.375618:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951083.375624:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f7fd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f451 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951083.375629:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951083.375648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2409:x1870607923920384:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 25us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951083.375655:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000020:00010000:0.0:1783951083.375780:0:9537:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e0248101000: total 0 00010000:00010000:0.0:1783951083.375816:0:9537:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e0248101000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783951083.375856:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3870d4b/0x7645c8e1169f90a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f936 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951083.375880:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac82027/0x7645c8e1169f89d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f753 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951083.375891:0:9537:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e0248101000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783951083.375897:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951083.375899:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951083.375900:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951083.376776:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+2:2406:x1870607923920896:12345-192.168.202.33@tcp:9:umount.0 Request processed in 1724us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951083.376787:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 80 00000100:00100000:1.0:1783951083.380315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951083.380385:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923921024 00000100:00100000:2.0:1783951083.380398:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923921024 00000100:00100000:2.0:1783951083.380589:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:2.0:1783951083.380602:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2406:x1870607923921024:12345-192.168.202.33@tcp:9:umount.0 00000020:00000080:2.0:1783951083.380681:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f83ab 00000100:00080000:2.0:1783951083.380694:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e0248100800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783951083.380744:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783951083.380755:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1783951083.380957:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+2:2406:x1870607923921024:12345-192.168.202.33@tcp:9:umount.0 Request processed in 358us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.380964:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 81 00000100:00100000:0.0:1783951083.389229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951083.389612:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922048 00000100:00100000:2.0:1783951083.389626:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922048 00000100:00100000:2.0:1783951083.389771:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 258 00000100:00100000:2.0:1783951083.389784:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+22:2406:x1870607923922048:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:2.0:1783951083.389852:0:10105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7fde 00000020:00010000:2.0:1783951083.389872:0:10105:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e024793a800: total 0 00000100:00080000:2.0:1783951083.389877:0:10105:0:(import.c:65:import_set_state_nolock()) ffff9e024793d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951083.390005:0:10105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1783951083.390445:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+21:2406:x1870607923922048:12345-192.168.202.33@tcp:39:umount.0 Request processed in 661us (1228us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1783951083.390455:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 258 00000020:00010000:1.0:1783951083.391978:0:6513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e024793a800: total 0 00010000:00010000:1.0:1783951083.392073:0:6513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e024793a800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783951083.392861:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951083.392866:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783951083.392880:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031800/0x7645c8e1169f89c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f74c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.392906:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:1.0:1783951083.392909:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951083.392912:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609400/0x7645c8e1169f8a42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f76f expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.392929:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0246937e00) 00010000:00010000:1.0:1783951083.392932:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951083.392936:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f8326 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f57e expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.392957:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951083.392959:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951083.392963:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5dc00/0x7645c8e1169f899a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f73e expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.392977:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:1.0:1783951083.392980:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951083.392984:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f867c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f66c expref: 16 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393024:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951083.393027:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951083.393031:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c000/0x7645c8e1169f8f89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f8e9 expref: 15 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393044:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e0247832c00) 00010000:00010000:1.0:1783951083.393047:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951083.393050:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5cc00/0x7645c8e1169f830a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f577 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393066:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951083.393069:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951083.393072:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5ce00/0x7645c8e1169f8a5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f776 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393083:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e0247828600) 00010000:00010000:1.0:1783951083.393085:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951083.393088:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608000/0x7645c8e1169f88ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f706 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393101:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e0247828500) 00010000:00010000:1.0:1783951083.393103:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951083.393107:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0340031c00/0x7645c8e1169f8d4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f84f expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393121:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951083.393123:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951083.393133:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9069 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f921 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393177:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e0247828800) 00010000:00010000:1.0:1783951083.393181:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783951083.393185:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169f9093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f92f expref: 9 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393202:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e024782ef00) 00010000:00010000:1.0:1783951083.393205:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951083.393209:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169f8381 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f593 expref: 8 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951083.393223:0:6513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e024793a800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783951083.393251:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951083.393254:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951083.393269:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951083.411767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951083.411960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922176 00000100:00100000:1.0:1783951083.411974:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922176 00000100:00100000:1.0:1783951083.412047:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 259 00000100:00100000:1.0:1783951083.412060:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+5:2406:x1870607923922176:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:1.0:1783951083.412106:0:6524:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7fe5 00000100:00080000:1.0:1783951083.412130:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9e037e6da000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783951083.412475:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783951083.412596:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783951083.412859:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75392fba-af18-4ae6-9b8a-6f1db7dcbeed+3:2406:x1870607923922176:12345-192.168.202.33@tcp:39:umount.0 Request processed in 800us (1105us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783951083.412870:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 259 00000100:00100000:3.0:1783951083.620488:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944935936:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951083.620600:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951083.623304:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951083.623951:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944935936 00000100:00100000:2.0:1783951083.623969:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944935936 00000100:00100000:2.0:1783951083.624055:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1783951083.624068:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944935936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951083.624134:0:13815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783951083.624552:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944935936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 485us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951083.624561:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1783951083.628373:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944935936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951084.129305:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944936064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951084.129419:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951084.130107:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936064 00000100:00100000:2.0:1783951084.130119:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936064 00000100:00100000:2.0:1783951084.130222:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783951084.130242:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944936064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951084.130290:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951084.130369:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944936064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951084.130378:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1783951084.130457:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951084.130737:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944936064:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783951084.640978:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951084.641579:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951084.641610:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944936192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951084.641718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951084.642049:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936192 00000100:00100000:0.0:1783951084.642061:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936192 00000100:00100000:0.0:1783951084.642178:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783951084.642189:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944936192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951084.642218:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951084.642277:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944936192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951084.642286:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1783951084.642415:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951084.642449:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944936192:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783951085.026188:0:13803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783951085.026203:0:13803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951085.026369:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1783951085.028111:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783951085.038915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951085.038984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951085.039025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951085.039734:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922304 00000100:00100000:2.0:1783951085.039735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922432 00000100:00100000:3.0:1783951085.039748:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922304 00000100:00100000:2.0:1783951085.039748:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922432 00000100:00100000:2.0:1783951085.039828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922560 00000100:00100000:2.0:1783951085.039831:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922560 00000100:00100000:1.0:1783951085.039842:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1783951085.041673:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5701fad6-85e7-4cf7-a012-ad03629e43ea+12:2407:x1870607923922432:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951085.041705:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951085.041741:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949e00/0x7645c8e1169f80e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4d6 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951085.041765:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951085.041865:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:2407:x1870607923922432:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 251us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951085.041875:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:3.0:1783951085.045870:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:3.0:1783951085.045894:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0343128850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5701fad6-85e7-4cf7-a012-ad03629e43ea+11:2407:x1870607923922304:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951085.045917:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951085.045944:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949400/0x7645c8e1169f80e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f4a5 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951085.045970:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951085.046070:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0343128850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5701fad6-85e7-4cf7-a012-ad03629e43ea+10:2407:x1870607923922304:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 185us (7171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951085.046079:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:3.0:1783951085.048977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951085.049038:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922816 00000100:00100000:3.0:1783951085.049051:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922816 00000100:00100000:3.0:1783951085.049164:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 260 00000100:00100000:3.0:1783951085.049178:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+6:2406:x1870607923922816:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:3.0:1783951085.049234:0:11194:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f80f6 00000020:00010000:3.0:1783951085.049244:0:11194:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e0248054800: total 0 00000100:00080000:3.0:1783951085.049250:0:11194:0:(import.c:65:import_set_state_nolock()) ffff9e0248056000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951085.049293:0:11194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1783951085.049873:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7ffa451-5324-4858-a00e-bb5627316d28+5:2406:x1870607923922816:12345-192.168.202.33@tcp:39:umount.0 Request processed in 694us (907us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1783951085.049883:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 260 00000020:00010000:3.0:1783951085.050079:0:9537:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e0248054800: total 0 00010000:00010000:3.0:1783951085.050084:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951085.053461:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951085.053742:0:9537:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e0248054800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783951085.053803:0:9537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247828300) 00010000:00010000:3.0:1783951085.053815:0:9537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951085.053831:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d200/0x7645c8e1169f90b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f93d expref: 4 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951085.053863:0:9537:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e0248054800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783951085.053880:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951085.053883:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951085.053885:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951085.056775:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:2.0:1783951085.056807:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+9:2407:x1870607923922560:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951085.056831:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951085.056868:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948200/0x7645c8e1169f82d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f562 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951085.056893:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951085.056978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5701fad6-85e7-4cf7-a012-ad03629e43ea+8:2407:x1870607923922560:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 189us (17951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951085.057000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:3.0:1783951085.058682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951085.058769:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923922944 00000100:00100000:2.0:1783951085.058780:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923922944 00000100:00100000:2.0:1783951085.058866:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 261 00000100:00100000:2.0:1783951085.058876:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+5:2406:x1870607923922944:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:2.0:1783951085.058928:0:10105:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f80fd 00000100:00080000:2.0:1783951085.058941:0:10105:0:(import.c:65:import_set_state_nolock()) ffff9e0381117800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951085.058976:0:10105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783951085.059237:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7ffa451-5324-4858-a00e-bb5627316d28+3:2406:x1870607923922944:12345-192.168.202.33@tcp:39:umount.0 Request processed in 361us (566us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783951085.059247:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 261 00010000:00010000:2.0:1783951085.059373:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951085.060342:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951085.099668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951085.099873:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923200 00000100:00100000:2.0:1783951085.099901:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923200 00000100:00100000:2.0:1783951085.099981:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 399 00000100:00100000:2.0:1783951085.099994:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+7:2406:x1870607923923200:12345-192.168.202.33@tcp:251:umount.0 00000020:00000080:2.0:1783951085.100056:0:6519:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7fbb 00000020:00010000:2.0:1783951085.100067:0:6519:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e037fc08000: total 0 00000100:00080000:2.0:1783951085.100073:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9e024793b000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783951085.100220:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5701fad6-85e7-4cf7-a012-ad03629e43ea+3:2406:x1870607923923200:12345-192.168.202.33@tcp:251:umount.0 Request processed in 228us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951085.100229:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 399 00000020:00010000:1.0:1783951085.100454:0:6513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e037fc08000: total 0 00010000:00010000:1.0:1783951085.100534:0:6513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e037fc08000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783951085.100580:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2e00/0x7645c8e1169f8094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f497 expref: 2 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951085.100596:0:6513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e037fc08000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783951085.100607:0:6513:0:(genops.c:906:class_export_put()) final put ffff9e037fc08000/5701fad6-85e7-4cf7-a012-ad03629e43ea 00010000:00010000:1.0:1783951085.100635:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951085.100645:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951085.100647:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783951085.100920:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037fc08000/5701fad6-85e7-4cf7-a012-ad03629e43ea for MGS 00000020:00000080:2.0:1783951085.100969:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024793b000 for MGS 00010000:00010000:3.0:1783951085.664316:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951085.673084:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951086.688389:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944936320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688525:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944936832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688598:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944937344:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688651:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944937856:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688673:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688697:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783951086.688703:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944936448:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688884:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944936960:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688921:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944937472:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688939:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.688966:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944936576:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.688988:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.689002:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944937088:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689020:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.689037:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944937600:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689056:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.689071:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783951086.689077:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944936704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689107:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.689117:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944937216:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.689186:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944937728:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951086.689238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936320 00000100:00100000:1.0:1783951086.689244:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936320 00000100:00100000:1.0:1783951086.689290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1783951086.689298:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944936320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689346:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1065061-5fe9-438e-843f-5f70939080ee+24:3652:x1870607944936320:12345-0@lo:400:kworker.0 Request processed in 48us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951086.689354:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1783951086.689384:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936832 00000100:00100000:1.0:1783951086.689388:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936832 00000100:00100000:1.0:1783951086.689412:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936576 00000100:00100000:1.0:1783951086.689415:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936576 00000100:00100000:1.0:1783951086.689430:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1783951086.689436:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944936832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689468:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944936832:12345-0@lo:400:kworker.0 Request processed in 32us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951086.689473:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1783951086.689484:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783951086.689490:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944936576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.689521:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944936576:12345-0@lo:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951086.689526:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783951086.689552:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937344 00000100:00100000:1.0:1783951086.689556:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937344 00000100:00100000:3.0:1783951086.689794:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936448 00000100:00100000:3.0:1783951086.689798:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936448 00000100:00100000:3.0:1783951086.689822:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936960 00000100:00100000:3.0:1783951086.689824:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936960 00000100:00100000:3.0:1783951086.689844:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937472 00000100:00100000:3.0:1783951086.689847:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937472 00000100:00100000:3.0:1783951086.689861:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937088 00000100:00100000:3.0:1783951086.689864:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937088 00000100:00100000:3.0:1783951086.689874:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937600 00000100:00100000:3.0:1783951086.689877:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937600 00000100:00100000:3.0:1783951086.689888:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1783951086.689894:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944936448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951086.689930:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944936448:12345-0@lo:400:kworker.0 Request processed in 36us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.689936:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1783951086.689946:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944936704 00000100:00100000:3.0:1783951086.689949:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944936704 00000100:00100000:3.0:1783951086.689963:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783951086.689968:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944936960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951086.690008:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944936960:12345-0@lo:400:kworker.0 Request processed in 39us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.690014:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783951086.690026:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783951086.690033:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944937472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951086.690060:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944937472:12345-0@lo:400:kworker.0 Request processed in 28us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.690066:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783951086.690077:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783951086.690084:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951086.690110:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944937088:12345-0@lo:400:kworker.0 Request processed in 27us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.690116:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783951086.690127:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783951086.690134:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944937600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951086.690180:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607944937600:12345-0@lo:400:kworker.0 Request processed in 46us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.690186:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783951086.690197:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783951086.690204:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944936704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951086.690230:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944936704:12345-0@lo:400:kworker.0 Request processed in 27us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.690236:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1783951086.690560:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937856 00000100:00100000:0.0:1783951086.690807:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937216 00000100:00100000:0.0:1783951086.690813:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937216 00000100:00100000:0.0:1783951086.690838:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937728 00000100:00100000:0.0:1783951086.690841:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937728 00000100:00100000:0.0:1783951086.690857:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951086.690864:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944937344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951086.690908:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944937344:12345-0@lo:400:kworker.0 Request processed in 43us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951086.690914:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783951086.690926:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783951086.690931:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944937216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951086.690957:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944937216:12345-0@lo:400:kworker.0 Request processed in 26us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951086.690963:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783951086.690974:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783951086.690980:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944937728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951086.691004:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944937728:12345-0@lo:400:kworker.0 Request processed in 25us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951086.691011:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1783951086.691029:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951086.691032:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951086.691035:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951086.691037:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951086.691069:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937856 00000100:00100000:1.0:1783951086.691110:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783951086.691117:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944937856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.691187:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944937856:12345-0@lo:400:kworker.0 Request processed in 70us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951086.691194:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00010000:1.0:1783951086.691272:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951086.691304:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944936704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.691317:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944937216:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.691326:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944937728:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.691337:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944936576:0@lo:400:kworker.0 00010000:00080000:1.0:1783951086.691351:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc66300 x1870607944937088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951086.691361:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944937088:0@lo:400:kworker.0 00010000:00080000:1.0:1783951086.691373:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc65880 x1870607944937600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951086.691382:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607944937600:0@lo:400:kworker.0 00000100:00080000:0.0:1783951086.691684:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951086.691821:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944937984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951086.691876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951086.691959:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944937984 00000100:00100000:0.0:1783951086.691964:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944937984 00000100:00100000:0.0:1783951086.692010:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783951086.692017:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944937984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951086.692041:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783951086.692089:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944937984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951086.692095:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783951086.692791:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944937984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951086.692939:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944936448:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.692951:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944936960:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.692962:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944937472:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.692987:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944936320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.692998:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944936832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.693009:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944937344:0@lo:400:kworker.0 00000100:00100000:1.0:1783951086.693021:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944937856:0@lo:400:kworker.0 00000100:00100000:0.0:1783951086.695381:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951086.695415:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944938112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951086.695481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951086.695526:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938112 00000100:00100000:0.0:1783951086.695533:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938112 00000100:00100000:0.0:1783951086.695686:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783951086.695696:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944938112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951086.695782:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783951086.695830:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944938112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951086.695837:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783951086.695881:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944938112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951086.698602:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951086.698632:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944938240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951086.698694:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951086.698856:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938240 00000100:00100000:3.0:1783951086.698863:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938240 00000100:00100000:3.0:1783951086.698912:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783951086.698921:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944938240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951086.698956:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783951086.699003:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944938240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951086.699010:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783951086.699050:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944938240:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1783951086.998470:0:15210:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783951087.026976:0:15210:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783951087.027047:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.027062:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.027072:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.027080:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.027172:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783951087.027179:0:15210:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783951087.027211:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951087.027216:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783951087.027223:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783951087.027249:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e03779c5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783951087.027369:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944938368:0@lo:39:umount.0 00000100:00100000:2.0:1783951087.027444:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951087.027718:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938368 00000100:00100000:1.0:1783951087.027725:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938368 00000100:00100000:1.0:1783951087.027770:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783951087.027779:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1870607944938368:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783951087.027814:0:11194:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7bd2 00000100:00080000:1.0:1783951087.027822:0:11194:0:(import.c:65:import_set_state_nolock()) ffff9e0377b50800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783951087.028182:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951087.028189:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.028199:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951087.028203:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.028211:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951087.028218:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951087.028231:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951087.028234:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783951087.028237:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783951087.028263:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.028271:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951087.028308:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.028316:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f8063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f806a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.028327:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951087.028329:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951087.028331:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951087.028381:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951087.028393:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944938496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951087.028426:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951087.028492:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938496 00000100:00100000:3.0:1783951087.028497:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938496 00000100:00100000:3.0:1783951087.028540:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951087.028548:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+24:3653:x1870607944938496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951087.028568:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951087.028782:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951087.028822:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5c600/0x7645c8e1169f806a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f8063 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.028834:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951087.028836:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3651:x1870607944938368:12345-0@lo:39:umount.0 Request processed in 1052us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951087.028845:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1783951087.028853:0:11194:0:(genops.c:906:class_export_put()) final put ffff9e0377b52000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1783951087.028876:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1065061-5fe9-438e-843f-5f70939080ee+23:3653:x1870607944938496:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951087.028885:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1783951087.028939:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b52000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783951087.028994:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0377b50800 for lustre-MDT0000 00000100:00100000:2.0:1783951087.029025:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944938496:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783951087.029055:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03779c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783951087.029069:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944938368:0@lo:39:umount.0 00000100:00080000:3.0:1783951087.029305:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951087.029316:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783951087.029320:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783951087.030215:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030231:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030239:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030246:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030268:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951087.030275:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030283:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030290:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030296:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030317:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951087.030325:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030336:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951087.030345:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030351:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030359:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67400 already unused, calling callback (ffffffffc1466c20) 00010000:00010000:3.0:1783951087.030364:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951087.030366:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030383:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030387:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951087.030397:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951087.030401:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951087.030403:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783951087.030404:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783951087.030414:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030422:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030429:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030431:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030444:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951087.030445:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951087.030456:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1783951087.030461:0:15210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783951087.030461:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951087.030468:0:15210:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783951087.030469:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67400/0x7645c8e1169f8071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f8078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030490:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951087.030492:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030497:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951087.030499:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951087.030501:0:15210:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:1.0:1783951087.030504:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1783951087.030506:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:1.0:1783951087.030511:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783951087.030514:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1783951087.030515:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951087.030518:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783951087.030520:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:3.0:1783951087.030521:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:1.0:1783951087.030531:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951087.030537:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e0246a36000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1783951087.030537:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1783951087.030546:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e0246679000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1783951087.030550:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951087.030553:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e037e5da000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1783951087.030558:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340030e00/0x7645c8e1169f7f75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7f7c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951087.030563:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e0377b56800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1783951087.030569:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951087.030572:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951087.030574:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e0248054800 f7ffa451-5324-4858-a00e-bb5627316d28 192.168.202.33@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951087.030588:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e024793a800 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 192.168.202.33@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00010000:00010000:1.0:1783951087.030589:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951087.030593:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951087.030598:0:15210:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e036b30b380) has exports, disconnecting them 00010000:00010000:1.0:1783951087.030600:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783951087.030614:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e0246a36000), last request at 1783951086 00000020:00000080:3.0:1783951087.030623:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7ee2 10000000:00010000:1.0:1783951087.030624:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783951087.030645:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e0246a37000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783951087.030688:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246a36000): rc 0 00000020:00000080:3.0:1783951087.030691:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0246a36000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783951087.030701:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e0246679000), last request at 1783951086 00000020:00000080:3.0:1783951087.030704:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7dca 00000100:00080000:3.0:1783951087.030709:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e024667a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783951087.030715:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246679000): rc 0 00000020:00000080:3.0:1783951087.030717:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0246679000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783951087.030723:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e037e5da000), last request at 1783950856 00000020:00000080:3.0:1783951087.030726:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7cb9 00000100:00080000:3.0:1783951087.030730:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9000 : changing import state from FULL to CLOSED 10000000:01000000:1.0:1783951087.030737:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:3.0:1783951087.030738:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e037e5da000): rc 0 10000000:01000000:1.0:1783951087.030743:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:00000080:3.0:1783951087.030744:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e037e5da000/lustre-MDT0000-lwp-MDT0001_UUID 10000000:01000000:1.0:1783951087.030748:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1783951087.030752:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e0377b56800), last request at 1783950856 00000020:00000080:3.0:1783951087.030757:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c7a 00000100:00080000:3.0:1783951087.030760:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e0377971800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783951087.030766:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1783951087.030767:0:15210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:1.0:1783951087.030775:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951087.030784:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030791:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f82cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f82d2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030800:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951087.030803:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030808:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951087.030811:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030826:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951087.030842:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951087.030849:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:3.0:1783951087.030850:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0377b56800): rc 0 10000000:01000000:1.0:1783951087.030855:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783951087.030858:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000004:00000080:3.0:1783951087.030859:0:15210:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb8e80188fae0 00010000:00010000:1.0:1783951087.030874:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783951087.030880:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:1.0:1783951087.030881:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783951087.030885:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1783951087.030890:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030897:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340030000/0x7645c8e1169f7b31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7b38 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.030907:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951087.030909:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951087.030911:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951087.030926:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944938752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951087.030992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951087.031039:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951087.031045:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944938880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951087.031067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951087.031111:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938752 00000100:00100000:1.0:1783951087.031118:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938752 00000100:00100000:1.0:1783951087.031190:0:10402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938880 00000100:00100000:1.0:1783951087.031193:0:10402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938880 00000100:00100000:1.0:1783951087.031216:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951087.031223:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1065061-5fe9-438e-843f-5f70939080ee+24:3654:x1870607944938752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951087.031236:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951087.031250:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f7f7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7f75 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.031264:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951087.031298:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1065061-5fe9-438e-843f-5f70939080ee+23:3654:x1870607944938752:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951087.031305:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951087.031321:0:10402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951087.031327:0:10402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1065061-5fe9-438e-843f-5f70939080ee+22:3654:x1870607944938880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951087.031335:0:10402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951087.031345:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f82d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f82cb expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951087.031354:0:10402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951087.031375:0:10402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1065061-5fe9-438e-843f-5f70939080ee+21:3654:x1870607944938880:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951087.031381:0:10402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:1.0:1783951087.031405:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246a36000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951087.031450:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246679000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951087.031472:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5da000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951087.031494:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246a37000 for lustre-MDT0000 00000020:00000080:1.0:1783951087.031498:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024667a000 for lustre-MDT0000 00000020:00000080:1.0:1783951087.031503:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e5d9000 for lustre-MDT0000 00000100:00100000:1.0:1783951087.031538:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944938880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951087.031547:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944938752:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783951087.031689:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783951087.031704:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e037e5dd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783951087.032051:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951087.032070:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944939008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951087.032107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951087.032161:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951087.032168:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944938624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951087.032194:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951087.032228:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939008 00000100:00100000:0.0:1783951087.032233:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939008 00000100:00100000:1.0:1783951087.032268:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944939136:0@lo:39:umount.0 00000100:00100000:0.0:1783951087.032279:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944938624 00000100:00100000:0.0:1783951087.032285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944938624 00000100:00100000:1.0:1783951087.032305:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951087.032310:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951087.032320:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+22:3652:x1870607944939008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951087.032333:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783951087.032346:0:13815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939136 00010000:00010000:0.0:1783951087.032348:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c3600/0x7645c8e1169f7b38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7b31 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951087.032351:0:13815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939136 00010000:00010000:0.0:1783951087.032366:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951087.032387:0:13815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783951087.032396:0:13815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1870607944939136:12345-0@lo:39:umount.0 00000100:00100000:0.0:1783951087.032404:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+21:3652:x1870607944939008:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951087.032412:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:1.0:1783951087.032422:0:13815:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7d14 00000100:00080000:1.0:1783951087.032432:0:13815:0:(import.c:65:import_set_state_nolock()) ffff9e03431bc800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783951087.032434:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951087.032445:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034312a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+20:3652:x1870607944938624:12345-0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1783951087.032454:0:13815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1783951087.032454:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951087.032466:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3c00/0x7645c8e1169f8078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f8071 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951087.032476:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951087.032497:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034312a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1065061-5fe9-438e-843f-5f70939080ee+19:3652:x1870607944938624:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951087.032504:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951087.032586:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944938624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951087.032592:0:13815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3651:x1870607944939136:12345-0@lo:39:umount.0 Request processed in 195us (284us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783951087.032603:0:13815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783951087.032728:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944939008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951087.032934:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951087.033068:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951087.033072:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1783951087.033093:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783951087.033181:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783951087.033196:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e0246421800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783951087.033204:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951087.033207:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1783951087.033220:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783951087.033287:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783951087.033298:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e0246424800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783951087.033325:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e036b30b380) has no exports 00010000:00010000:1.0:1783951087.034104:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951087.034197:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944939264:0@lo:9:umount.0 00000100:00100000:0.0:1783951087.034248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951087.034294:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944939392:0@lo:9:umount.0 00000100:00100000:1.0:1783951087.034299:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939264 00000100:00100000:1.0:1783951087.034306:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939264 00000100:00100000:0.0:1783951087.034329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951087.034359:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939392 00000100:00100000:1.0:1783951087.034363:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939392 00000100:00080000:0.0:1783951087.034371:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e5dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783951087.034378:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944939136:0@lo:39:umount.0 00000100:00100000:1.0:1783951087.034394:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783951087.034404:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1870607944939264:12345-0@lo:9:umount.0 00000100:00100000:0.0:1783951087.034415:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783951087.034425:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1870607944939392:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783951087.034428:0:9851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e64 00000100:00080000:1.0:1783951087.034437:0:9851:0:(import.c:65:import_set_state_nolock()) ffff9e02466df800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783951087.034442:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7fa6 00000100:00080000:0.0:1783951087.034451:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9e0247468000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951087.034481:0:9851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:0.0:1783951087.034494:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1783951087.034624:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3651:x1870607944939264:12345-0@lo:9:umount.0 Request processed in 221us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951087.034640:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783951087.034764:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3651:x1870607944939392:12345-0@lo:9:umount.0 Request processed in 341us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951087.034771:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1783951087.034788:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951087.034804:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246421800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783951087.034821:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783951087.034823:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951087.034826:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944939264:0@lo:9:umount.0 00000100:00080000:0.0:1783951087.034837:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246424800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783951087.034844:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783951087.034846:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951087.034848:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944939392:0@lo:9:umount.0 00010000:00010000:2.0:1783951087.035108:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783951087.040643:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e036b30b380) has no exports 00000020:00000080:3.0:1783951087.079441:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b8c 00000020:00000080:3.0:1783951087.079458:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0377975000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783951087.079515:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783951087.079696:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951087.079709:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783951087.079727:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e0377958000) has no exports 00000020:00000080:2.0:1783951087.080009:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b85 00000020:00000080:2.0:1783951087.080015:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0377956000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783951087.080105:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377975000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783951087.080370:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377956000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951087.080437:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951087.080445:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783951087.080448:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0377951800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783951087.080451:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377951800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783951087.080458:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1783951087.712462:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951088.736451:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951089.249181:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951089.249436:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944939520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951089.249515:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951089.249778:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939520 00000100:00100000:2.0:1783951089.249789:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939520 00000100:00080000:0.0:1783951089.249866:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951089.249890:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783951089.249907:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944939520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951089.249938:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951089.249994:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944939520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951089.250002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783951089.250068:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944939520:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1783951089.252115:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783951089.252133:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000001:00100000:0.0:1783951089.252405:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951089.252418:0:6504:0:(genops.c:906:class_export_put()) final put ffff9e0377b56800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783951089.252614:0:7456:0:(genops.c:906:class_export_put()) final put ffff9e0377b62800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783951089.252641:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000001:00080000:0.0:1783951089.252647:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1783951089.252651:0:6504:0:(genops.c:906:class_export_put()) final put ffff9e0248054800/f7ffa451-5324-4858-a00e-bb5627316d28 00000020:00000080:1.0:1783951089.252918:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b56800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951089.252987:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0377971800 for lustre-MDT0000 00000001:00100000:1.0:1783951089.253045:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951089.253050:0:9517:0:(genops.c:906:class_export_put()) final put ffff9e024746d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783951089.253065:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:1.0:1783951089.253067:0:9517:0:(genops.c:906:class_export_put()) final put ffff9e0248101000/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:1.0:1783951089.253080:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024746d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783951089.253107:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248101000/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-OST0001 00000020:00000080:1.0:1783951089.253130:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0247468000 for lustre-OST0001 00000020:00000080:1.0:1783951089.253134:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0248106000 for lustre-OST0001 00000001:00100000:3.0:1783951089.253384:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f7ffa451-5324-4858-a00e-bb5627316d28 00000001:00080000:3.0:1783951089.253391:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1783951089.253394:0:7456:0:(genops.c:906:class_export_put()) final put ffff9e0381116800/f7ffa451-5324-4858-a00e-bb5627316d28 00000001:00100000:3.0:1783951089.253399:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000001:00080000:3.0:1783951089.253403:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1783951089.253412:0:7456:0:(genops.c:906:class_export_put()) final put ffff9e037e508800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000001:00100000:0.0:1783951089.253492:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000001:00080000:0.0:1783951089.253498:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1783951089.253504:0:6504:0:(genops.c:906:class_export_put()) final put ffff9e024793a800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000001:00100000:3.0:1783951089.253598:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951089.253603:0:8434:0:(genops.c:906:class_export_put()) final put ffff9e02466de800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783951089.253610:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:3.0:1783951089.253612:0:8434:0:(genops.c:906:class_export_put()) final put ffff9e0248106800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed 00000020:00000080:1.0:1783951089.253710:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b62800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783951089.265133:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0381116800/f7ffa451-5324-4858-a00e-bb5627316d28 for lustre-MDT0001 00000020:00000080:1.0:1783951089.272089:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e508800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-MDT0001 00000020:00000080:1.0:1783951089.280221:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248054800/f7ffa451-5324-4858-a00e-bb5627316d28 for lustre-MDT0000 00000020:00000080:0.0:1783951089.283939:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024793a800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-MDT0000 00000020:00000080:0.0:1783951089.289418:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02466de800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783951089.292082:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248106800/75392fba-af18-4ae6-9b8a-6f1db7dcbeed for lustre-OST0000 00000020:00000080:0.0:1783951089.301882:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03431bc800 for lustre-MDT0001 00000020:00000080:0.0:1783951089.301904:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0381117800 for lustre-MDT0001 00000020:00000080:0.0:1783951089.301910:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e6da000 for lustre-MDT0001 00000020:00000080:0.0:1783951089.301916:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0248056000 for lustre-MDT0000 00000020:00000080:0.0:1783951089.301921:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024793d000 for lustre-MDT0000 00000020:00000080:0.0:1783951089.301926:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02466df800 for lustre-OST0000 00000020:00000080:0.0:1783951089.301930:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0248100800 for lustre-OST0000 00010000:00010000:2.0:1783951089.760915:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951090.785402:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951091.808465:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944939776:0@lo:400:kworker.0 00000100:00100000:0.0:1783951091.808552:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.808638:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944939648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951091.808671:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951091.808831:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951091.808853:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944939904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951091.808885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951091.808907:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951091.808913:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944940032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951091.808933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951091.808976:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939648 00000100:00100000:2.0:1783951091.808983:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939648 00000100:00100000:2.0:1783951091.809306:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940032 00000100:00100000:2.0:1783951091.809311:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940032 00000100:00100000:2.0:1783951091.809328:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783951091.809335:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1870607944939648:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783951091.809358:0:6530:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783951091.809395:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1870607944939648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (722us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783951091.809402:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783951091.809416:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1783951091.809420:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1870607944940032:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783951091.809424:0:6530:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783951091.809448:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1870607944940032:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783951091.809454:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1783951091.809483:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783951091.809488:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783951091.809492:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783951091.812757:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951091.812779:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944940160:0@lo:400:kworker.0 00000100:00100000:3.0:1783951091.812802:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939904 00000100:00100000:3.0:1783951091.812812:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939904 00000100:00100000:0.0:1783951091.812858:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951091.812880:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951091.812908:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944939776 00000100:00100000:0.0:1783951091.812913:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944939776 00000100:00100000:0.0:1783951091.812945:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1783951091.812952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:3655:x1870607944939776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951091.813017:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1065061-5fe9-438e-843f-5f70939080ee+19:3655:x1870607944939776:12345-0@lo:400:kworker.0 Request processed in 65us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951091.813039:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00080000:0.0:1783951091.813074:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951091.813088:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940160 00000100:00100000:0.0:1783951091.813091:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940160 00000100:00100000:0.0:1783951091.813117:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783951091.813122:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1870607944940160:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951091.813129:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951091.813172:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1870607944940160:12345-0@lo:400:kworker.0 Request processed in 48us (316us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951091.813178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1783951091.813221:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951091.813226:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e0348b9c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951091.813231:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951091.813236:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e0348b9c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951091.813241:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 211 00000100:00080000:0.0:1783951091.813246:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e0348b9c000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951091.813274:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03489c4a80 x1870607944940288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951091.813296:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944940160:0@lo:400:kworker.0 00000100:00100000:0.0:1783951091.813310:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944939776:0@lo:400:kworker.0 00000100:00100000:0.0:1783951091.813334:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944940288:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783951091.813358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951091.813388:0:10105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940288 00000100:00100000:0.0:1783951091.813391:0:10105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940288 00000100:00100000:0.0:1783951091.813419:0:10105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783951091.813424:0:10105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1870607944940288:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1783951091.813437:0:10105:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783951091.814201:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944939904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951091.814236:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783951091.814284:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944939904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1396us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951091.814292:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:02020000:3.0:1783951091.814335:0:3654:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1783951091.814347:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1783951091.815418:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951091.815436:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944940544:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.815484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.815523:0:11194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940544 00000100:00100000:1.0:1783951091.815529:0:11194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940544 00000100:00100000:1.0:1783951091.815599:0:11194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1783951091.815623:0:11194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944940544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.815668:0:11194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944940544:12345-0@lo:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951091.815675:0:11194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:1.0:1783951091.815694:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783951091.815715:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02479c6300 x1870607944940544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951091.815727:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944940544:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.815764:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944940672:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.815791:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.815820:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940672 00000100:00100000:1.0:1783951091.815824:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940672 00000100:00100000:1.0:1783951091.815854:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783951091.816109:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944940672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.816165:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944940672:12345-0@lo:400:kworker.0 Request processed in 58us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951091.816181:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1783951091.816199:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951091.816214:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944940672:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.816279:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944940416:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.816303:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.816320:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944940928:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.816338:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.816353:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951091.816357:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944940800:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.816384:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.816405:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940416 00000100:00100000:1.0:1783951091.816408:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940416 00000100:00100000:1.0:1783951091.816425:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940928 00000100:00100000:1.0:1783951091.816427:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940928 00000100:00100000:1.0:1783951091.816443:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944940800 00000100:00100000:1.0:1783951091.816446:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944940800 00000100:00100000:1.0:1783951091.816455:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1783951091.816460:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944940928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.816490:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944940928:12345-0@lo:400:kworker.0 Request processed in 30us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951091.816495:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1783951091.816505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783951091.816510:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1870607944940416:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951091.816514:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951091.817661:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1870607944940416:12345-0@lo:400:kworker.0 Request processed in 23us (230us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951091.817676:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783951091.817702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783951091.817708:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1870607944940800:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951091.817713:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951091.817766:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1870607944940800:12345-0@lo:400:kworker.0 Request processed in 57us (1380us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951091.817773:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1783951091.817798:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951091.817827:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951091.817833:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951091.817836:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951091.817851:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951091.817856:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 255 00000100:00080000:1.0:1783951091.817862:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e024770b800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951091.817888:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc64a80 x1870607944941056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951091.817922:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944940800:0@lo:400:kworker.0 00000100:00080000:1.0:1783951091.817935:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951091.817938:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951091.817941:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951091.817944:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951091.817947:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 234 00000100:00080000:1.0:1783951091.817951:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e02466dd800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951091.817963:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc66d80 x1870607944941184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951091.817973:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944940416:0@lo:400:kworker.0 00010000:00080000:1.0:1783951091.817986:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e02479c7480 x1870607944940928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951091.817997:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944940928:0@lo:400:kworker.0 00000100:00100000:1.0:1783951091.818066:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944941056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783951091.818097:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.818115:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944941184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783951091.818134:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951091.818203:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941056 00000100:00100000:1.0:1783951091.818208:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941056 00000100:00100000:1.0:1783951091.818230:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941184 00000100:00100000:1.0:1783951091.818234:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941184 00000100:00100000:1.0:1783951091.818248:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783951091.818252:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944941056:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1783951091.818267:0:6526:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783951091.818297:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944941056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (199us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951091.818303:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783951091.818314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783951091.818317:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944941184:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1783951091.818324:0:6526:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783951091.818342:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944941184:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 24us (208us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951091.818348:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1783951091.818372:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951091.818377:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951091.818380:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944941056:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783951091.818387:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951091.818390:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951091.818392:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944941184:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1783951091.827559:0:3654:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9e0380fb4000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1783951091.827690:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951091.827699:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 211 00000100:00080000:2.0:1783951091.827709:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e0380fb4000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951091.827755:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024856aa00 x1870607944941312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951091.827822:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944941312:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783951091.827896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951091.828300:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944940032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951091.828355:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944939904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951091.828550:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941312 00000100:00100000:3.0:1783951091.828557:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941312 00000100:00100000:3.0:1783951091.828605:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783951091.828612:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944941312:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1783951091.828729:0:6530:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783951091.828780:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944941312:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 167us (883us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951091.828788:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1783951091.828808:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951091.828813:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951091.828834:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944941312:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783951091.848663:0:10105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1870607944940288:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35226us (35293us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951091.848678:0:10105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1783951091.852088:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0348b9c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951091.852101:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951091.852106:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944940288:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1783951092.832419:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783951093.152283:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02478b5660 - data ffff9e03517ad360/ffff9e037fc1ac00 00000020:01000000:2.0:1783951093.152609:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e0371c76420 - data ffff9e0372560438/ffff9e0377b27400 00000001:00000004:2.0:1783951093.158204:0:15210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1783951093.228016:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783951093.228025:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1783951093.228043:0:15210:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e0248608e00 x1870607944939136/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951097 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951093.228086:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783951093.244375:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951093.244384:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1783951093.244444:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951093.244447:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783951093.248448:0:8757:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783951093.248456:0:8757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1783951093.248467:0:8757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783951093.249202:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951093.249207:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1783951093.249219:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951093.249222:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783951093.250286:0:9858:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783951093.250292:0:9858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1783951093.250301:0:9858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783951093.251885:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b54 00000020:00000080:3.0:1783951093.251896:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0351b56000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951093.253076:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0351b56000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951093.259884:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b69 00000020:00000080:3.0:1783951093.259899:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e035a7c7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783951093.259923:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783951093.259929:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.259938:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951093.259942:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e036b3099c0) has no exports 00000004:01000000:3.0:1783951093.260126:0:15210:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783951093.260136:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7f9f 00000020:00000080:3.0:1783951093.260170:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e024746c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783951093.260175:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783951093.260178:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.260188:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951093.260191:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9e0246b419c0) has no exports 00000020:00000080:3.0:1783951093.260198:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7f98 00000020:00000080:3.0:1783951093.260202:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e02466d8800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783951093.260528:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783951093.260533:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951093.260536:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1783951093.260542:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951093.260544:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951093.260603:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.260612:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951093.260618:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e5d 00000020:00000080:3.0:1783951093.260624:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e02466da800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783951093.260627:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783951093.260630:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.260633:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951093.260636:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e037795cd40) has no exports 00000020:00000080:3.0:1783951093.260639:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e56 00000020:00000080:3.0:1783951093.260642:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0246427000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783951093.260917:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783951093.260921:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951093.260923:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1783951093.260926:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951093.260927:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951093.260951:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.260956:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783951093.260966:0:15210:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783951093.260970:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7d0d 00000020:00000080:3.0:1783951093.260974:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e037e5dd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783951093.260977:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783951093.260980:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.260983:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951093.260985:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e0351ba8000) has no exports 00000020:00000080:3.0:1783951093.260988:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7d06 00000020:00000080:3.0:1783951093.260991:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e037e5dc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951093.263071:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035a7c7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783951093.263090:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024746c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783951093.263098:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02466d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783951093.263103:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246424800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783951093.263115:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0247469800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951093.263117:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247469800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783951093.263121:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951093.263219:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02466da800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783951093.263225:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246427000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783951093.263230:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246421800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783951093.263234:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0246a33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951093.263236:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246a33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783951093.263239:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951093.263266:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5dd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783951093.263271:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783951093.303519:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1783951093.303527:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783951093.303531:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1783951093.303540:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951093.303611:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.303624:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951093.303661:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.303665:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951093.303672:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0351b54800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951093.303676:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0351b54800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783951093.303687:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951093.304069:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e5dd800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783951093.304077:0:37:0:(genops.c:906:class_export_put()) final put ffff9e037e5dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951093.304080:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5dc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783951093.304087:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951093.304294:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b70 00000020:00000080:3.0:1783951093.304301:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e035a7c1000/lustre-MDD0000_UUID 00000020:01000000:3.0:1783951093.304319:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783951093.304323:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.304328:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951093.304331:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e0351bab380) has no exports 00000020:00000080:3.0:1783951093.304350:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.304353:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783951093.304357:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b77 00000020:00000080:3.0:1783951093.304361:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0351b54000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783951093.304369:0:15210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0343db6000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783951093.304372:0:15210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db6000 3 00000020:01000004:3.0:1783951093.304375:0:15210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0343db6000 from lustre-MDT0000 00000020:00000080:3.0:1783951093.304391:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.304395:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783951093.304397:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0351b53000/lustre-MDT0000_UUID 00000020:00000080:3.0:1783951093.304399:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0351b53000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783951093.304405:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783951093.304437:0:15210:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1783951093.304441:0:15210:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783951093.304444:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783951093.304446:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.304449:0:15210:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951093.304455:0:15210:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e0342df5800 d1065061-5fe9-438e-843f-5f70939080ee 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951093.304460:0:15210:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e036b308000) has exports, disconnecting them 00000020:00080000:3.0:1783951093.304464:0:15210:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e0342df5800), last request at 1783950835 00000020:00000080:3.0:1783951093.304479:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b15 00000020:00010000:3.0:1783951093.304491:0:15210:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e0342df5800: total 2 00000100:00080000:3.0:1783951093.304495:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9e0342df0000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783951093.304567:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035a7c1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783951093.304577:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0351b51000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783951093.304579:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0351b51000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783951093.304582:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783951093.304614:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0351b54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1783951093.304645:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0342df5800): rc 0 00000020:00080000:3.0:1783951093.304650:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e036b308000) has no exports 00000100:00100000:1.0:1783951093.304750:0:6519:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e035a78aa00:6519] 1 exiting: rc = 0 00000100:00100000:1.0:1783951093.304861:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e036d3be200:6517] 0 exiting: rc = 1 00000100:00100000:1.0:1783951093.304918:0:6520:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e036d3ae200:6520] 2 exiting: rc = 0 00000100:00100000:3.0:1783951093.305079:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305087:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305094:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305100:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305105:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305112:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305117:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305124:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305131:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305136:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305172:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305179:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305186:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305192:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305198:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305205:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305211:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305218:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305224:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305230:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305235:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305241:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305247:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305253:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305260:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305266:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305271:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305277:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305283:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305289:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305295:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305310:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305316:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305322:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305327:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305333:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305339:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305345:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305351:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305356:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305362:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305366:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305371:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305376:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305382:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305387:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305394:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305399:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305404:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305423:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305428:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305434:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305439:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305445:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305451:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305457:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305463:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305468:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305474:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305479:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305485:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305491:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305495:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951093.305501:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1783951093.306694:0:6512:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e0342df5800: total 0 00010000:00010000:0.0:1783951093.306747:0:6512:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e0342df5800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783951093.306776:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f8086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f807f expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306792:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f8016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f800f expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306804:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948000/0x7645c8e1169f82c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f82bd expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306813:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948600/0x7645c8e1169f82b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f82af expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306823:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f8024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f801d expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306833:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f7f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7f2f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306846:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3200/0x7645c8e1169f8032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f802b expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306873:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949800/0x7645c8e1169f8040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f8039 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306882:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2200/0x7645c8e1169f804e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f8047 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306893:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03427e9200/0x7645c8e1169f7c11 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7c0a expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306905:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03427e9400/0x7645c8e1169f7c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f7c18 expref: 4 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306915:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949600/0x7645c8e1169f82a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f82a1 expref: 3 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306926:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f805c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f8055 expref: 2 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951093.306935:0:6512:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e0342df5800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1783951093.306949:0:6512:0:(genops.c:906:class_export_put()) final put ffff9e0342df5800/d1065061-5fe9-438e-843f-5f70939080ee 00010000:00010000:0.0:1783951093.307044:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951093.307047:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951093.307049:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951093.307086:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0342df5800/d1065061-5fe9-438e-843f-5f70939080ee for MGS 00000020:00000080:3.0:1783951093.307126:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0342df0000 for MGS 00000020:01000000:3.0:1783951093.308314:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02478b58a0 - data ffff9e03517ad5e8/ffff9e037fc1a800 00000020:01000000:3.0:1783951093.308776:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e034a7304e0 - data ffff9e0372456d80/ffff9e0351f1f000 00000020:00000080:3.0:1783951093.309374:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7af9 00000020:00000080:3.0:1783951093.309383:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0348b99800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783951093.309401:0:15210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0343db6000 from MGS, refs=2 00000020:01000004:3.0:1783951093.309404:0:15210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db6000 2 00000020:01000004:3.0:1783951093.309419:0:15210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0343db6000 from MGS 00000020:00000080:3.0:1783951093.309444:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951093.309451:0:15210:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783951093.309453:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0343db3800/MGS 00000020:00000080:3.0:1783951093.309456:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0343db3800/MGS for MGS 00000020:01000000:3.0:1783951093.309462:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783951093.309520:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783951093.309523:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951093.309529:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951093.309536:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e03779c3000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951093.309541:0:15210:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9e036d358000) has exports, disconnecting them 00000020:00080000:3.0:1783951093.309558:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e03779c3000), last request at 1783950836 00000020:00000080:3.0:1783951093.309562:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7bc4 00000020:00080000:3.0:1783951093.309572:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03779c3000): rc 0 00000020:00000080:3.0:1783951093.309577:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e03779c3000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783951093.310676:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0348b99800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783951093.310696:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03779c3000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783951093.322218:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783951093.322226:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951093.322231:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783951093.322237:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951093.322380:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951093.322389:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783951093.322396:0:15210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db6000 1 00000020:00000080:1.0:1783951093.322403:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7aeb 00000020:00000080:1.0:1783951093.322411:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0343db7800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783951093.322417:0:15210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783951093.322422:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951093.322427:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783951093.322431:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e036b30cd40) has no exports 00000020:00000080:0.0:1783951093.325673:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03779c5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783951093.325689:0:36:0:(genops.c:906:class_export_put()) final put ffff9e0348868800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783951093.325692:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0348868800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783951093.325699:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783951093.325788:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0343db7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783951093.371848:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951093.371860:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783951093.371867:0:15210:0:(genops.c:906:class_export_put()) final put ffff9e0343db1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951093.371872:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0343db1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783951093.371877:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783951093.371994:0:15210:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e0343db4000 00000020:02000400:1.0:1783951093.372062:0:15210:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783951093.856417:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951094.369478:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951094.369501:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944941440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951094.369581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951094.369651:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941440 00000100:00100000:2.0:1783951094.369658:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941440 00000100:00100000:2.0:1783951094.369714:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783951094.369724:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944941440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951094.369754:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951094.369792:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944941440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951094.369799:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1783951094.369818:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951094.369850:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944941440:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783951094.881914:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951095.906712:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783951095.908676:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951096.929604:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944941568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951096.929676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951096.929801:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941568 00000100:00100000:0.0:1783951096.929809:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941568 00000100:00100000:0.0:1783951096.929875:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783951096.929886:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944941568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951096.929918:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783951096.929967:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944941568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951096.929975:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783951096.930024:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944941568:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783951096.930094:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783951096.930757:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951096.930914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951096.930919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951096.930922:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951096.930927:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1783951096.930932:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951096.930937:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e0380fb4000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951096.930972:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248608380 x1870607944941824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951096.930994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951096.930998:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951096.931000:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0348b9c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951096.931003:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1783951096.931006:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951096.931009:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e0348b9c000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951096.931019:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860b480 x1870607944941952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951096.931028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951096.931031:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951096.931032:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951096.931035:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1783951096.931037:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951096.931040:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e02466dd800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951096.931049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248188000 x1870607944942080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951096.931076:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951096.931079:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951096.931081:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951096.931084:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1783951096.931086:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951096.931089:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e024770b800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951096.931106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860e300 x1870607944942464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951096.931134:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944942336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951096.931195:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951096.931227:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951096.931232:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944942592:0@lo:400:kworker.0 00000100:00100000:3.0:1783951096.931255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951096.931285:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942592 00000100:00100000:3.0:1783951096.931290:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942592 00000100:00100000:2.0:1783951096.931400:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944941824:0@lo:38:kworker.0 00000100:00100000:2.0:1783951096.931429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951096.931448:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944941952:0@lo:38:kworker.0 00000100:00100000:2.0:1783951096.931464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951096.931481:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944942080:0@lo:38:kworker.0 00000100:00100000:2.0:1783951096.931498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951096.931525:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944942464:0@lo:38:kworker.0 00000100:00100000:2.0:1783951096.931559:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951096.931589:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941824 00000100:00100000:2.0:1783951096.931592:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941824 00000100:00100000:2.0:1783951096.931616:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783951096.931622:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607944941824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951096.931641:0:6531:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951096.931676:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607944941824:12345-0@lo:38:kworker.0 Request processed in 53us (246us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951096.931683:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783951096.931703:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944941952 00000100:00100000:2.0:1783951096.931706:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944941952 00000100:00100000:2.0:1783951096.931721:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942080 00000100:00100000:2.0:1783951096.931723:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942080 00000100:00100000:2.0:1783951096.931731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942464 00000100:00100000:2.0:1783951096.931733:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942464 00000100:00100000:2.0:1783951096.931743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783951096.931748:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944941952:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951096.931757:0:6524:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951096.931783:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944941952:12345-0@lo:38:kworker.0 Request processed in 34us (318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951096.931789:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783951096.931800:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1783951096.931804:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944942080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951096.931813:0:6524:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951096.931836:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944942080:12345-0@lo:38:kworker.0 Request processed in 30us (338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951096.931842:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1783951096.931861:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783951096.931865:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944942464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951096.931874:0:6524:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951096.931899:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944942464:12345-0@lo:38:kworker.0 Request processed in 32us (340us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951096.931905:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1783951096.931942:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951096.931947:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951096.931950:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944941824:0@lo:38:kworker.0 00000100:00080000:2.0:1783951096.931959:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0348b9c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951096.931963:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951096.931965:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944941952:0@lo:38:kworker.0 00000100:00080000:2.0:1783951096.931972:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951096.931975:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951096.931977:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944942080:0@lo:38:kworker.0 00000100:00080000:2.0:1783951096.931983:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951096.931986:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951096.931988:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944942464:0@lo:38:kworker.0 00000100:00100000:0.0:1783951096.932076:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942336 00000100:00100000:0.0:1783951096.932081:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942336 00000100:00100000:0.0:1783951096.932122:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783951096.932131:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944942336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951096.932195:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944942336:12345-0@lo:400:kworker.0 Request processed in 66us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951096.932203:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783951096.932229:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944941696:0@lo:400:kworker.0 00000400:00000100:0.0:1783951096.932250:0:3654:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870607944941696 offset 0 length 224: 4 00000100:00100000:0.0:1783951096.932273:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951096.932278:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944942208:0@lo:400:kworker.0 00000100:00100000:0.0:1783951096.932300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951096.932351:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944942336:0@lo:400:kworker.0 00000100:00100000:0.0:1783951096.932370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942208 00000100:00100000:0.0:1783951096.932373:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942208 00000100:00100000:3.0:1783951096.933524:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783951096.933541:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944942592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951096.933604:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944942592:12345-0@lo:400:kworker.0 Request processed in 71us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951096.933611:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00080000:1.0:1783951096.933683:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e024860e680 x1870607944942592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951096.933705:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944942592:0@lo:400:kworker.0 00000100:00100000:2.0:1783951096.940564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1783951096.940589:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944942208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951096.940690:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944942208:12345-0@lo:400:kworker.0 Request processed in 115us (8388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951096.940698:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00080000:0.0:1783951096.941057:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e024818ad80 x1870607944942208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951096.941073:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024818ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944942208:0@lo:400:kworker.0 00000100:00080000:3.0:1783951096.941815:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951096.941822:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:2.0:1783951097.142780:0:15411:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783951097.160559:0:15411:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1783951097.160628:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.160647:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.160656:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.160663:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.160686:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783951097.160693:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1783951097.160707:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951097.160715:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951097.160723:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1783951097.160723:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783951097.160727:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951097.160729:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783951097.160736:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1783951097.160736:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951097.160743:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9e0348b9c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:00010000:0.0:1783951097.160744:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951097.160750:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:0.0:1783951097.160750:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783951097.160752:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 10000000:01000000:0.0:1783951097.160753:0:9537:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:1.0:1783951097.160755:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783951097.160756:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783951097.160805:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951097.160812:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951097.160842:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951097.160851:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f8047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f804e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951097.160887:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951097.160889:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951097.160892:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951097.160920:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944942720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951097.161017:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951097.161064:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942720 00000100:00100000:0.0:1783951097.161073:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942720 00000100:00100000:0.0:1783951097.161123:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783951097.161133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3654:x1870607944942720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783951097.161164:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951097 with bad export cookie 8522438738941278997 00010000:00010000:1.0:1783951097.161714:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161742:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161788:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161796:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161828:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951097.161849:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161857:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161863:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161883:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161911:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951097.161936:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951097.161942:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161950:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951097.161967:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.161973:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951097.161992:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951097.161996:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951097.161998:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1783951097.162024:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162028:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951097.162049:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162054:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f8055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f805c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162065:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951097.162067:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162070:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951097.162072:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162077:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951097.162080:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951097.162093:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951097.162101:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783951097.162103:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783951097.162116:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162120:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951097.162131:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162136:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145800/0x7645c8e1169f7f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7f36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162170:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951097.162172:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951097.162173:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951097.162182:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944942976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951097.162223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951097.162293:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162300:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162305:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162320:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162330:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951097.162334:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162354:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162358:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162362:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162378:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783951097.162380:0:15411:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1783951097.162382:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1783951097.162403:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951097.162414:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162418:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951097.162420:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162425:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951097.162429:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951097.162432:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783951097.162433:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783951097.162434:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783951097.162449:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162453:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951097.162462:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162470:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f82bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f82c4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162479:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951097.162482:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162488:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951097.162491:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162497:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951097.162504:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951097.162509:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951097.162521:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783951097.162523:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783951097.162533:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162537:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951097.162541:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162550:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e8800/0x7645c8e1169f7c18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f7c1f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951097.162560:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951097.162561:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951097.162562:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951097.162569:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944943104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951097.162589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1783951097.162626:0:15411:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1783951097.162632:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1783951097.162637:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951097.162661:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783951097.162666:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e024746b800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951097.162671:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e024667f000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951097.162675:0:15411:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9e037d323380) has exports, disconnecting them 00000020:00080000:1.0:1783951097.162679:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e024746b800), last request at 1783951096 00000020:00000080:1.0:1783951097.162685:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7ef7 00000100:00080000:1.0:1783951097.162699:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9e0247469000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783951097.162746:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783951097.162766:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e024746b800): rc 0 00000020:00000080:1.0:1783951097.162768:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e024746b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1783951097.162776:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e024667f000), last request at 1783951096 00000020:00000080:1.0:1783951097.162779:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7dd1 00000100:00080000:1.0:1783951097.162782:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9e024667e000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783951097.162799:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783951097.162803:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e024667f000): rc 0 00000020:00000080:1.0:1783951097.162804:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e024667f000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1783951097.162828:0:15411:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb8e801923ae0 00000100:00080000:1.0:1783951097.162857:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951097.162864:0:15411:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9e024860b800 x1870607944939648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951107 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951097.162880:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1783951097.163819:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783951097.163841:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1783951097.165663:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944942848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951097.165758:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951097.165799:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951097.165806:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944943232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951097.165832:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951097.165857:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951097.167689:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942976 00000100:00100000:3.0:1783951097.167709:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942976 00000100:00100000:3.0:1783951097.167749:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944943104 00000100:00100000:3.0:1783951097.167753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944943104 00000100:00100000:3.0:1783951097.167761:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944942848 00000100:00100000:3.0:1783951097.167764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944942848 00000100:00100000:3.0:1783951097.167772:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944943232 00000100:00100000:3.0:1783951097.167774:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944943232 00000100:00100000:3.0:1783951097.167789:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951097.167799:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1870607944942976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783951097.167826:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951097 with bad export cookie 8522438738941278997 00000100:00100000:3.0:1783951097.167926:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1870607944942976:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (5700us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783951097.167936:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951097.167960:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1783951097.167960:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951097.167970:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from FULL to DISCONN 00000100:00100000:3.0:1783951097.167971:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3653:x1870607944943104:12345-0@lo:103:ldlm_bl.0 00000100:02020000:1.0:1783951097.167979:0:3652:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00020000:3.0:1783951097.167981:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951097 with bad export cookie 8522438738941278997 00000100:00100000:3.0:1783951097.168026:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3653:x1870607944943104:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (5434us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783951097.168031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951097.168043:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951097.168047:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1870607944942848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783951097.168050:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951097 with bad export cookie 8522438738941278997 00000100:00100000:3.0:1783951097.168079:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1870607944942848:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (2322us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783951097.168085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951097.168096:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951097.168100:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1870607944943232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783951097.168104:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951097 with bad export cookie 8522438738941278997 00000100:00100000:3.0:1783951097.168130:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1870607944943232:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (2298us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783951097.168136:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1783951097.168217:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951097.170034:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783951097.170088:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783951097.171027:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3654:x1870607944942720:12345-0@lo:103:ldlm_bl.0 Request processed in 9890us (10007us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951097.171042:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:0.0:1783951097.171093:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024746b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1783951097.171190:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024667f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1783951097.171218:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0247469000 for lustre-MDT0001 00000020:00000080:0.0:1783951097.171223:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024667e000 for lustre-MDT0001 00000100:00080000:0.0:1783951097.172403:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783951097.172411:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1783951097.172429:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783951097.172497:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783951097.172545:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9e0246a33800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783951097.172565:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783951097.172568:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1783951097.172578:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783951097.172716:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783951097.172728:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9e0247938000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783951097.172757:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9e037d323380) has no exports 00000100:00100000:0.0:1783951097.177771:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944943360:0@lo:9:umount.0 00000100:00100000:0.0:1783951097.177897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951097.177964:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944943488:0@lo:9:umount.0 00000100:00100000:0.0:1783951097.177990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951097.178084:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951097.187623:0:3652:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.133@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783951097.187631:0:3652:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783951097.187643:0:3652:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0248608e00 x1870607944941696/t0(0) o400->MGC192.168.202.133@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951112 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951097.187662:0:3652:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03489c7800 x1870607944942720/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951113 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951097.187673:0:3652:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037fc65880 x1870607944942976/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951113 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951097.187683:0:3652:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037fc67100 x1870607944943104/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951113 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951097.187692:0:3652:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037fc64a80 x1870607944942848/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951113 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951097.187725:0:3652:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037fc67480 x1870607944943232/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951113 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783951097.187734:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783951097.187738:0:3652:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783951097.187739:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783951097.187744:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e03431b9000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1783951097.187745:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951097.187753:0:3652:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 191 00000100:00080000:1.0:1783951097.187765:0:3652:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e03431b9000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951097.187780:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944942848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951097.187805:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944943360 00000100:00100000:1.0:1783951097.187816:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944943360 00000100:00100000:3.0:1783951097.187828:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1065061-5fe9-438e-843f-5f70939080ee:3655:1870607944943232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951097.187881:0:9851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944943488 00000100:00100000:1.0:1783951097.187885:0:9851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944943488 00000100:00100000:3.0:1783951097.187908:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783951097.187920:0:9851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783951097.187922:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1870607944943360:12345-0@lo:9:umount.0 00000100:00100000:1.0:1783951097.187933:0:9851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1870607944943488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783951097.187965:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e2c 00000020:00000080:1.0:1783951097.187965:0:9851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7f60 00000100:00080000:3.0:1783951097.187979:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9e024667d000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1783951097.187980:0:9851:0:(import.c:65:import_set_state_nolock()) ffff9e024793e800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783951097.188030:0:3654:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e03431b9000 already not connected (conn 2, was 1): CONNECTING 00000001:00000004:1.0:1783951097.188037:0:9851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783951097.188075:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944941696:0@lo:400:kworker.0 00000100:00100000:0.0:1783951097.188083:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944939648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951097.188103:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1065061-5fe9-438e-843f-5f70939080ee:3654:1870607944942720:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1783951097.188206:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1783951097.188308:0:9851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3651:x1870607944943488:12345-0@lo:9:umount.0 Request processed in 377us (10315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951097.188317:0:9851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783951097.188349:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3651:x1870607944943360:12345-0@lo:9:umount.0 Request processed in 430us (10452us total) trans 0 rc 0/0 00010000:00010000:1.0:1783951097.188355:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951097.188357:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1783951097.188395:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246a33800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1783951097.188653:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783951097.188729:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951097.188733:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951097.188738:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944943360:0@lo:9:umount.0 00000100:00080000:1.0:1783951097.188759:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0247938000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951097.188771:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951097.188774:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951097.188787:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944943488:0@lo:9:umount.0 00000100:00100000:1.0:1783951097.188909:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02479c7480 x1870607944943616/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951097.188948:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944943616:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1783951097.188984:0:3653:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e03431b9000 already not connected (conn 2, was 1): CONNECTING 00000400:00000100:1.0:1783951097.188991:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870607944943616 offset 0 length 520: 4 00000100:00100000:1.0:1783951097.189041:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1065061-5fe9-438e-843f-5f70939080ee:3652:1870607944942976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951097.189129:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1065061-5fe9-438e-843f-5f70939080ee:3653:1870607944943104:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1783951097.200567:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9e037d323380) has no exports 00000020:01000000:2.0:1783951097.236687:0:15411:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02478b53c0 - data ffff9e037266a0d8/ffff9e037fc1a000 00000020:01000000:2.0:1783951097.236842:0:15411:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03779f6d80 - data ffff9e03726410d8/ffff9e0351b38000 00000001:00000004:2.0:1783951097.254454:0:15411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1783951097.296424:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951097.296433:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1783951097.296443:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783951097.298114:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951097.298120:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1783951097.298439:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951097.298442:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783951097.298842:0:8753:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783951097.298847:0:8753:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1783951097.298858:0:8753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783951097.299470:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951097.299474:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1783951097.299492:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951097.299493:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783951097.299706:0:9849:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783951097.299710:0:9849:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1783951097.299717:0:9849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783951097.300887:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c3b 00000020:00000080:3.0:1783951097.300897:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0377b66800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783951097.302531:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b66800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783951097.302930:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c50 00000020:00000080:3.0:1783951097.302954:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e034886a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951097.302991:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1783951097.302997:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e034886a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1783951097.302998:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951097.303013:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783951097.303035:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9e036d3599c0) has no exports 00000004:01000000:3.0:1783951097.303313:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783951097.303325:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7f59 00000020:00000080:3.0:1783951097.303330:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e024770f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951097.303345:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783951097.303349:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951097.303358:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951097.303360:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9e0247710000) has no exports 00000020:00000080:3.0:1783951097.303368:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7f52 00000020:00000080:3.0:1783951097.303372:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e024793d800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783951097.303383:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024770f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1783951097.303402:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024793d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783951097.305666:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783951097.305677:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951097.305682:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1783951097.305693:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951097.305696:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951097.305763:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0247938000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783951097.306066:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951097.306085:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783951097.306092:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e024770e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783951097.306097:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024770e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1783951097.306107:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783951097.306257:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e17 00000020:00000080:3.0:1783951097.306265:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0246a30000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951097.306282:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783951097.306286:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951097.306293:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951097.306298:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9e037795b380) has no exports 00000020:00000080:3.0:1783951097.306306:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e10 00000020:00000080:3.0:1783951097.306312:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0246a31000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783951097.306313:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246a30000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1783951097.306744:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246a31000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783951097.307221:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783951097.307228:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951097.307232:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1783951097.307251:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951097.307254:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951097.307310:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951097.307320:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1783951097.307338:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783951097.307347:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c73 00000020:00000080:1.0:1783951097.307372:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246a33800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783951097.307384:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0246420800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951097.307387:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246420800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1783951097.307394:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783951097.307420:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e037e50f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951097.307438:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1783951097.307443:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951097.307448:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951097.307453:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e037d0acd40) has no exports 00000020:00000080:3.0:1783951097.307459:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c6c 00000020:00000080:3.0:1783951097.307466:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0380fb5000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783951097.307528:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e50f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783951097.307540:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0380fb5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1783951097.311203:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1783951097.311221:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951097.311225:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1783951097.311235:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951097.311397:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0380fb4000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1783951097.311439:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951097.311454:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951097.311459:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0380fb6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951097.311477:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0380fb6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1783951097.311485:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951097.311653:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951097.311658:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951097.311661:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0377b66000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951097.311663:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b66000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783951097.311667:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951097.311774:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c57 00000020:00000080:0.0:1783951097.311782:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e034886b800/lustre-MDD0001_UUID 00000020:01000000:0.0:1783951097.311799:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1783951097.311802:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951097.311808:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783951097.311811:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9e037d324d40) has no exports 00000020:00000080:0.0:1783951097.311829:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951097.311832:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1783951097.311836:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7c5e 00000020:00000080:0.0:1783951097.311839:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e034886f000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1783951097.311845:0:15411:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0377b14000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1783951097.311848:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377b14000 2 00000020:01000004:0.0:1783951097.311851:0:15411:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0377b14000 from lustre-MDT0001 00000020:00000080:0.0:1783951097.311868:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951097.311872:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1783951097.311905:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e034886b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1783951097.311909:0:36:0:(genops.c:906:class_export_put()) final put ffff9e03431bb800/lustre-MDD0001_UUID 00000020:00000080:1.0:1783951097.311911:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03431bb800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1783951097.311919:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1783951097.312104:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0377b60800/lustre-MDT0001_UUID 00000020:00000080:0.0:1783951097.312107:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b60800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1783951097.312113:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1783951097.312163:0:15411:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1783951097.312167:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1783951097.312170:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951097.312174:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783951097.312180:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e037e5df000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783951097.312185:0:15411:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9e0351bacd40) has exports, disconnecting them 00000020:00080000:0.0:1783951097.312195:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e037e5df000), last request at 1783950856 00000020:00000080:0.0:1783951097.312200:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7cb2 00000020:00080000:0.0:1783951097.312212:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e037e5df000): rc 0 00000020:00000080:0.0:1783951097.312216:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e037e5df000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783951097.312503:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e034886f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783951097.312509:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5df000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1783951097.313396:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1783951097.313402:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951097.313416:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783951097.313421:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951097.313440:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0348b9c000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783951097.313573:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951097.313580:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783951097.313584:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0351b57800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783951097.313588:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0351b57800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783951097.313593:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783951097.313635:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377b14000 1 00000020:00000080:1.0:1783951097.313640:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7bee 00000020:00000080:1.0:1783951097.313645:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0350e69000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1783951097.313654:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783951097.313661:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0350e69000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783951097.313672:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951097.313675:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783951097.313678:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9e037d0ab380) has no exports 00000020:00000080:3.0:1783951097.381842:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951097.381858:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783951097.381863:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e0377b14800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783951097.381868:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377b14800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783951097.381879:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783951097.382048:0:15411:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e0377b12800 00000020:01000000:3.0:1783951097.382068:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783951097.382072:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951097.382076:0:15411:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783951097.382080:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e036d35cd40) has no exports 00000100:00100000:0.0:1783951097.382457:0:10105:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e037fc11200:10105] 3 exiting: rc = 0 00000100:00100000:2.0:1783951097.382746:0:11194:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e02476c2a00:11194] 4 exiting: rc = 0 00000100:00100000:1.0:1783951097.382885:0:6527:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e0342c4f800:6527] 2 exiting: rc = 0 00000100:00100000:1.0:1783951097.382964:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e0342c4ee00:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1783951097.383104:0:6526:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e0342c4f200:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1783951097.383744:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383754:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383761:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383768:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383774:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383779:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383786:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383792:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383798:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383804:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383810:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383815:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383821:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383826:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383831:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383837:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383842:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383848:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383853:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383859:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383865:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383871:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383876:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383882:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383889:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383894:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383901:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383921:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383926:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383932:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383937:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383943:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383949:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383954:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383959:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383964:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383969:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383974:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383980:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383986:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383992:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.383998:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384004:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384010:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384015:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384020:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384026:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384032:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384038:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384044:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384049:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384054:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384059:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384064:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384069:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384075:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384084:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384090:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384095:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384101:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384106:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384112:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384125:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951097.384559:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.388956:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e0342c4f600:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1783951097.389110:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e0342c4ea00:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1783951097.389243:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389252:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389260:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389267:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389274:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389280:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389286:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389291:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389312:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389318:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389324:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389330:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389336:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389341:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389347:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389352:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389443:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389449:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389455:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389460:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389465:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389470:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389475:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389480:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389485:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389489:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389494:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389499:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389503:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389508:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389522:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389527:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389532:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389536:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389541:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389545:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389550:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389555:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389560:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389565:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389570:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389574:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389579:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389589:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389594:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389599:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389604:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389609:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389614:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389619:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389624:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389629:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389633:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389638:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389643:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389647:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389652:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389657:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389661:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389666:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389672:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389678:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389684:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.389689:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951097.390775:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e0378e48e00:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1783951097.390897:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e0378e49200:6531] 1 exiting: rc = 0 00000100:00100000:2.0:1783951097.390960:0:13815:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e038117a000:13815] 2 exiting: rc = 0 00000100:00100000:3.0:1783951097.391497:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391649:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391658:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391664:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391670:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391677:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391694:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391701:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391706:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391712:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391718:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391724:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391730:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391735:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391749:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391754:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391760:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391766:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391782:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391789:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391794:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391800:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391806:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391812:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391818:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391824:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391831:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391837:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391842:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391848:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391867:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391873:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391878:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391884:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391890:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391895:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391903:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391908:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391914:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391920:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391926:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391933:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391950:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391957:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391962:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391968:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391974:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391979:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391985:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.391996:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392001:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392007:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392013:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392019:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392048:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392060:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392077:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392098:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392120:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392137:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392283:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392426:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392444:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.392468:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951097.403758:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e03494efa00:6532] 0 exiting: rc = 1 00000100:00100000:2.0:1783951097.403887:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e03494eea00:6533] 1 exiting: rc = 0 00000100:00100000:3.0:1783951097.403981:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.403989:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.403994:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404000:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404005:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404011:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404015:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404021:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404026:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404032:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404037:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404043:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404048:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404054:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404058:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404063:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404069:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404073:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404079:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404083:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404100:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404105:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404111:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404116:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404121:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404127:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404132:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404137:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404175:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404181:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404186:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404191:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404196:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404200:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404205:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404220:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404225:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404231:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404236:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404242:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404247:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404252:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404258:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404262:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404267:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404272:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404277:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404281:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404286:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404302:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404308:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404312:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404317:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404321:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404326:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404340:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404344:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404349:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404757:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404768:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404773:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404778:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404784:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.404789:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951097.405830:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e0346184200:6535] 1 exiting: rc = 0 00000100:00100000:2.0:1783951097.405989:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e0346185400:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1783951097.406109:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406115:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406120:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406125:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406129:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406134:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406138:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406550:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406555:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406560:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406566:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406571:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406576:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406581:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406585:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406591:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406596:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406601:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406606:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406611:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406615:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406620:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406625:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406630:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406634:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406639:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406656:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406660:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406665:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406670:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406675:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406680:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406685:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406690:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406695:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406699:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406704:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406709:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406714:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406719:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406723:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406727:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406732:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406737:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406741:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406746:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406750:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406755:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406760:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406765:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406770:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406775:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406779:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406784:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406789:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406795:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406800:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406805:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406810:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406815:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406819:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406832:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406836:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.406841:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951097.407734:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e0346184000:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1783951097.407844:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e036d312200:6537] 1 exiting: rc = 0 00000100:00100000:3.0:1783951097.407985:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.407992:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.407997:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408003:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408008:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408013:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408018:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408023:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408028:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408033:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408039:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408043:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408048:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408053:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408058:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408062:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408067:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408072:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408076:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408081:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408086:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408090:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408094:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408100:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408105:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408110:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408116:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408121:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408126:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408132:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408138:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408497:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408522:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408528:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408534:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408539:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408544:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408549:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408555:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408560:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408565:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408570:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408575:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408580:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408585:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408589:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408594:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408599:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408603:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408608:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408612:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408617:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408621:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408625:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408630:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408635:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408639:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408644:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408649:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408654:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408659:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408664:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408669:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.408674:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.409281:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e03460b6800:6540] 2 exiting: rc = 0 00000100:00100000:1.0:1783951097.409668:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e03460b7c00:6538] 0 exiting: rc = 1 00000100:00100000:2.0:1783951097.409907:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e03460b6000:6539] 1 exiting: rc = 0 00000100:00100000:3.0:1783951097.410007:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410013:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410031:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410037:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410042:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410055:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410063:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410069:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410075:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410080:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410086:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410091:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410097:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410104:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410124:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410130:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410136:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410445:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410455:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410461:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410472:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410478:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410484:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410489:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410495:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410500:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410506:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410522:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410529:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410535:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410541:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410546:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410551:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410557:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410562:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410567:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410582:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410602:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410610:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410615:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410620:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410626:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410632:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410638:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410643:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410650:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410656:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410664:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410669:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410677:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410683:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410690:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410696:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410702:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410709:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410715:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410721:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410726:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410732:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410738:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410743:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410749:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951097.410755:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783951097.417906:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951097.417921:0:15411:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1783951097.417927:0:15411:0:(genops.c:906:class_export_put()) final put ffff9e03431b9800/MDS_uuid 00000020:00000080:3.0:1783951097.417932:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03431b9800/MDS_uuid for MDS 00000020:01000000:3.0:1783951097.417937:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1783951097.418102:0:15411:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1783951097.953756:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951098.976492:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951100.000858:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951101.025435:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783951101.459612:0:15612:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783951101.471239:0:15612:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783951101.471294:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951101.471309:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951101.471326:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951101.471334:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951101.471354:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783951101.471358:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783951101.471381:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951101.471385:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951101.471390:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783951101.471405:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9e02466dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783951101.471410:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951101.471427:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951101.471430:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783951101.472387:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951101.472524:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951101.472530:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783951101.472551:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9e02466da000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783951101.472615:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607944943744:0@lo:39:umount.0 00000400:00000100:2.0:1783951101.472666:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607944943744 offset 0 length 224: 4 00010000:00010000:1.0:1783951101.472789:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951101.472796:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951101.472803:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951101.472806:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951101.472824:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951101.472829:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951101.472833:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951101.472835:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783951101.472837:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783951101.472848:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:1.0:1783951101.472851:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951101.472855:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f802b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8032 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951101.472862:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951101.472863:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951101.472864:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951102.049526:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951102.049537:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951102.049541:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951102.049545:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951102.049549:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951102.049558:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1783951102.049564:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951102.049571:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e024770b800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951102.049618:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860f100 x1870607944943872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951102.049873:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944944000:0@lo:400:kworker.0 00000400:00000100:3.0:1783951102.049930:0:3655:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607944944000 offset 0 length 224: 4 00010000:00010000:2.0:1783951102.050433:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951102.050498:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944943872:0@lo:38:kworker.0 00000400:00000100:2.0:1783951102.050530:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607944943872 offset 0 length 520: 4 00010000:00010000:2.0:1783951103.085106:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951103.092084:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783951103.092095:0:9517:0:(genops.c:906:class_export_put()) final put ffff9e0247938800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951103.092170:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247938800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783951103.092349:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024793e800 for lustre-OST0001 00000001:00100000:0.0:1783951103.150780:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951103.150790:0:8434:0:(genops.c:906:class_export_put()) final put ffff9e024667e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783951103.155123:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024667e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783951103.155206:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024667d000 for lustre-OST0000 00010000:00010000:1.0:1783951104.097634:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951105.121469:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951106.144714:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951107.168316:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951107.173869:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951097/real 1783951097] req@ffff9e02479c7480 x1870607944943616/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951107 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951107.173903:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e02479c7480 x1870607944943616/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951107 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951107.173923:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951107.173943:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783951107.173948:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944943616:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1783951107.174172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951107.174178:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783951107.174181:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951107.174186:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1783951107.174192:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951107.174199:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e03431b9000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951107.174232:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02479c5f80 x1870607944944128/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951107.174274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951107.174278:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951107.174623:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951107.174638:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944944256:0@lo:400:kworker.0 00000400:00000100:0.0:1783951107.174693:0:3653:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607944944256 offset 0 length 224: 4 00000100:00100000:3.0:1783951107.175137:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944944128:0@lo:250:kworker.0 00000400:00000100:3.0:1783951107.175212:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870607944944128 offset 0 length 520: 4 00010000:00010000:0.0:1783951108.199972:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951109.218060:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951110.240710:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951111.264279:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951101/real 1783951101] req@ffff9e0247b66a00 x1870607944943744/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951111.264337:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e0247b66a00 x1870607944943744/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951111.264356:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02466da000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783951111.264373:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607944943744:0@lo:39:umount.0 00000100:00080000:0.0:1783951111.264457:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951111.264463:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951111.264467:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951111.265339:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265362:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265371:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265379:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265422:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951111.265429:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265436:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265442:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265448:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951111.265467:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783951111.265471:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783951111.265495:0:15612:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783951111.265498:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783951111.265502:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951111.265507:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951111.265511:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e03779599c0) has no exports 00000020:00080000:0.0:1783951111.265531:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e03779599c0) has no exports 00000020:01000000:0.0:1783951111.267285:0:15612:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02478b5060 - data ffff9e03726df5e8/ffff9e03811ab800 00010000:00010000:3.0:1783951111.268556:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951111.268568:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268580:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951111.268584:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268595:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951111.268602:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951111.268608:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951111.268611:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783951111.268615:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783951111.268633:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:3.0:1783951111.268637:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268644:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f8039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8040 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268679:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951111.268683:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268689:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951111.268691:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268697:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951111.268702:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951111.268706:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951111.268708:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783951111.268710:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783951111.268717:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:3.0:1783951111.268719:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268724:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f82af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f82b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951111.268731:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951111.268732:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951111.268734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951111.268806:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951111.270774:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783951111.272283:0:15612:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03810351e0 - data ffff9e037267cca8/ffff9e0246967400 00100000:10000000:1.0:1783951111.292704:0:15612:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783951111.306233:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7d8b 00000020:00000080:2.0:1783951111.306244:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e0246420000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783951111.306267:0:15612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0377952800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783951111.306271:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377952800 2 00000020:01000004:2.0:1783951111.306274:0:15612:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0377952800 from lustre-OST0000 00000020:00000080:2.0:1783951111.306297:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951111.306306:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783951111.306309:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e0246422800/lustre-OST0000_UUID 00000020:00000080:2.0:1783951111.306322:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246422800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783951111.306328:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783951111.306403:0:15612:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783951111.306408:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783951111.306412:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951111.306416:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951111.306423:0:15612:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e02466de000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951111.306428:0:15612:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9e037d0a8000) has exports, disconnecting them 00000020:00080000:2.0:1783951111.306433:0:15612:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e02466de000), last request at 1783950878 00000020:00000080:2.0:1783951111.306437:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7db5 00000020:00080000:2.0:1783951111.306446:0:15612:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e02466de000): rc 0 00000020:00000080:2.0:1783951111.306451:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e02466de000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783951111.306684:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246420000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783951111.306696:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02466de000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1783951111.309207:0:15612:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783951111.309215:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951111.309219:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783951111.309235:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951111.309375:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951111.309393:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1783951111.309399:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783951111.309403:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951111.309407:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951111.309414:0:15612:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e02466d9000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951111.309420:0:15612:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9e037d0a99c0) has exports, disconnecting them 00000020:00080000:3.0:1783951111.309425:0:15612:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e02466d9000), last request at 1783950878 00000020:00000080:3.0:1783951111.309429:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7dc3 00000020:00080000:3.0:1783951111.309446:0:15612:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e02466d9000): rc 0 00000020:00000080:3.0:1783951111.309453:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e02466d9000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783951111.310511:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02466dd800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783951111.310522:0:38:0:(genops.c:906:class_export_put()) final put ffff9e037e5de800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783951111.310525:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5de800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783951111.310532:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783951111.310593:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02466d9000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1783951111.319255:0:15612:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783951111.319263:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951111.319267:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783951111.319275:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951111.319308:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02466da000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783951111.319493:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951111.319503:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1783951111.319508:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e02466db000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1783951111.319512:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02466db000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1783951111.319522:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1783951111.319589:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377952800 1 00000020:00000080:0.0:1783951111.319597:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7d53 00000020:00000080:0.0:1783951111.319604:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e0381192000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1783951111.319631:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783951111.319640:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0381192000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783951111.319650:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951111.319655:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951111.319659:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9e037d320000) has no exports 00000020:00000080:0.0:1783951111.503876:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951111.503887:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783951111.503891:0:15612:0:(genops.c:906:class_export_put()) final put ffff9e0377970000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783951111.503894:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377970000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783951111.503905:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783951111.504008:0:15612:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e03431bf800 00000020:02000400:0.0:1783951111.504051:0:15612:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783951112.288385:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951112.289513:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951112.289522:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951112.289524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951112.289527:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951112.289594:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944944384:0@lo:400:kworker.0 00000400:00000100:2.0:1783951112.289648:0:3653:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607944944384 offset 0 length 224: 4 00010000:00010000:0.0:1783951113.315619:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951114.336515:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951115.361097:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783951115.951624:0:15814:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783951115.968644:0:15814:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783951115.968761:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951115.968985:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951115.968996:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951115.969004:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951115.972608:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783951115.972630:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783951115.972699:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951115.972716:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e024860f100 x1870607944943872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951115.972751:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951115.972758:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783951115.972766:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9e024770b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783951115.972773:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951115.972777:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e024860f100 x1870607944943872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951122 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951115.972783:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951115.972787:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1783951115.974304:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944943872:0@lo:38:kworker.0 00000100:00080000:0.0:1783951115.975681:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951115.975700:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e024860d180 x1870607944944000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951118 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951115.975726:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e02479c6300 x1870607944944256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951115.975778:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0248337100 x1870607944944384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951115.975786:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951115.975791:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783951115.976483:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944944000:0@lo:400:kworker.0 00000100:00080000:0.0:1783951115.976595:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9e024770d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783951115.976650:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607944944512:0@lo:39:umount.0 00000400:00000100:1.0:1783951115.976717:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607944944512 offset 0 length 224: 4 00010000:00010000:2.0:1783951115.980971:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951115.980990:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951115.981005:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951115.981010:0:9537:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951115.981022:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951115.981041:0:9537:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951115.981048:0:9537:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951115.981051:0:9537:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783951115.981055:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783951115.981078:0:9537:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:2.0:1783951115.981083:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951115.981091:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66e00/0x7645c8e1169f800f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8016 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951115.981166:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944944384:0@lo:400:kworker.0 00000100:00100000:2.0:1783951115.981198:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944944256:0@lo:400:kworker.0 00010000:00010000:2.0:1783951115.981435:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951115.981438:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951115.981440:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951116.384773:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951117.408379:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951117.409544:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951117.409554:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783951118.435775:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951119.456402:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951120.480377:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951121.507440:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951122.144274:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951107/real 1783951107] req@ffff9e02479c5f80 x1870607944944128/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951122 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951122.144324:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e02479c5f80 x1870607944944128/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951122 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951122.144345:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951122.144370:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783951122.144374:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944944128:0@lo:250:kworker.0 00000100:00080000:0.0:1783951122.144471:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d1065061-5fe9-438e-843f-5f70939080ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951122.144476:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783951122.144480:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951122.144484:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 462 00000100:00080000:0.0:1783951122.144490:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951122.144496:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e03431b9000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951122.144530:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247b65500 x1870607944944640/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951122.144599:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944944640:0@lo:250:kworker.0 00000400:00000100:2.0:1783951122.144654:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870607944944640 offset 0 length 520: 4 00010000:00010000:1.0:1783951122.528494:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951123.553576:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951124.576981:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951125.217242:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951115/real 1783951115] req@ffff9e0247b67800 x1870607944944512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951125.217287:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e0247b67800 x1870607944944512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951125.217306:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e024770d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783951125.217328:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607944944512:0@lo:39:umount.0 00000100:00080000:0.0:1783951125.217464:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951125.217469:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951125.217475:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951125.218524:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218538:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218545:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218569:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218597:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951125.218605:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218612:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218618:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.218624:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951125.219027:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783951125.219033:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783951125.219059:0:15814:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783951125.219065:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783951125.219070:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951125.219075:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951125.219080:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9e0246b40000) has no exports 00000020:00080000:0.0:1783951125.219114:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9e0246b40000) has no exports 00000020:01000000:0.0:1783951125.220986:0:15814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e0381035000 - data ffff9e037264cca8/ffff9e038131b400 00000020:01000000:0.0:1783951125.221131:0:15814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02478b5e40 - data ffff9e0372680288/ffff9e0247815000 00010000:00010000:3.0:1783951125.224550:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951125.224571:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224588:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951125.224593:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224605:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951125.224637:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951125.224643:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951125.224646:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783951125.224649:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783951125.224669:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:3.0:1783951125.224673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224680:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f801d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8024 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224695:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951125.224700:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224706:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951125.224709:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224714:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951125.224720:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951125.224725:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951125.224727:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783951125.224736:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783951125.224743:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:3.0:1783951125.224746:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224752:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f82a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f82a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951125.224764:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951125.224766:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951125.224768:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951125.227842:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1783951125.238844:0:15814:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783951125.249725:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7eb1 00000020:00000080:1.0:1783951125.249736:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e024746b000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783951125.249759:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0241aa4000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783951125.249763:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0241aa4000 2 00000020:01000004:1.0:1783951125.249766:0:15814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0241aa4000 from lustre-OST0001 00000020:00000080:1.0:1783951125.249790:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951125.249800:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783951125.249803:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e024746c800/lustre-OST0001_UUID 00000020:00000080:1.0:1783951125.249816:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024746c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783951125.249823:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783951125.249940:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d1065061-5fe9-438e-843f-5f70939080ee->MGS 00010000:00010000:1.0:1783951125.249955:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f7c0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951125.249966:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f7c0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951125.249973:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783951125.249976:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783951125.249979:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783951125.249992:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:1.0:1783951125.249996:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f7c0a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f7c11 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951125.250010:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951125.250018:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951125.250023:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951125.250026:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783951125.250028:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783951125.250043:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e03431b9000 00010000:00010000:1.0:1783951125.250046:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f807f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f8086 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951125.250062:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9e03431b9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783951125.250066:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783951125.250073:0:15814:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783951125.250075:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783951125.250078:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783951125.250089:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0247b65500 x1870607944944640/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783951142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1783951125.252470:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024746b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1783951125.252525:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783951125.252530:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1783951125.266124:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1065061-5fe9-438e-843f-5f70939080ee:3651:1870607944944640:0@lo:250:kworker.0 10000000:01000000:1.0:1783951125.266238:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783951125.266252:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7b07 00000020:00000080:1.0:1783951125.266271:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e03431b8000/d1065061-5fe9-438e-843f-5f70939080ee 00000020:01000000:1.0:1783951125.266294:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.133@tcp (flags='') 00000020:00000080:1.0:1783951125.266303:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951125.266309:0:15814:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951125.266314:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9e036d35b380) has no exports 00000020:00000080:2.0:1783951125.268272:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03431b8000/d1065061-5fe9-438e-843f-5f70939080ee for MGC192.168.202.133@tcp 10000000:01000000:3.0:1783951125.268551:0:6522:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783951125.268665:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.133@tcp: client import never connected 00000100:00080000:1.0:1783951125.268670:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783951125.268674:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783951125.268678:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783951125.268680:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783951125.268737:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951125.268747:0:15814:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.133@tcp (uuid d1065061-5fe9-438e-843f-5f70939080ee) 00000020:01000000:1.0:1783951125.268755:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783951125.268763:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951125.268768:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783951125.268775:0:15814:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e0247708800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951125.268781:0:15814:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9e0247713380) has exports, disconnecting them 00000020:00080000:1.0:1783951125.268785:0:15814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e0247708800), last request at 1783950900 00000020:00000080:1.0:1783951125.268790:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7edb 00000020:00080000:1.0:1783951125.268803:0:15814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0247708800): rc 0 00000020:00000080:1.0:1783951125.268809:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e0247708800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783951125.270350:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03431b9000 for MGC192.168.202.133@tcp 00000020:00000080:3.0:1783951125.270364:0:38:0:(genops.c:906:class_export_put()) final put ffff9e03438c8000/d1065061-5fe9-438e-843f-5f70939080ee 00000020:00000080:3.0:1783951125.270367:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03438c8000/d1065061-5fe9-438e-843f-5f70939080ee for MGC192.168.202.133@tcp 00000020:01000000:3.0:1783951125.270374:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.133@tcp (d1065061-5fe9-438e-843f-5f70939080ee) 00000020:00000080:3.0:1783951125.270650:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247708800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783951125.299330:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783951125.299339:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951125.299343:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783951125.299350:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783951125.299596:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951125.299605:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783951125.299613:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783951125.299617:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951125.299622:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951125.299629:0:15814:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e024770c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951125.299636:0:15814:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9e0247714d40) has exports, disconnecting them 00000020:00080000:2.0:1783951125.299641:0:15814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e024770c000), last request at 1783950900 00000020:00000080:2.0:1783951125.299645:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7ef0 00000020:00080000:2.0:1783951125.299662:0:15814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e024770c000): rc 0 00000020:00000080:2.0:1783951125.299668:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e024770c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1783951125.299757:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024770b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783951125.299765:0:38:0:(genops.c:906:class_export_put()) final put ffff9e0247708000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783951125.299768:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247708000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783951125.299778:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783951125.301084:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024770c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1783951125.333437:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783951125.333447:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783951125.333451:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783951125.333460:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783951125.333535:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783951125.333684:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1783951125.333797:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024770d000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1783951125.333812:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1783951125.334291:0:7466:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9e0359c1cc00:7466] 2 exiting: rc = 0 00000100:00100000:3.0:1783951125.334361:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e035a78a400:6507] 0 exiting: rc = 1 00000100:00100000:1.0:1783951125.334443:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e0344b07a00:6508] 1 exiting: rc = 0 00000100:00100000:3.0:1783951125.334535:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.334783:0:10402:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e037d167c00:10402] 3 exiting: rc = 0 00000100:00100000:1.0:1783951125.334894:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e0344b06200:6510] 1 exiting: rc = 0 00000100:00100000:1.0:1783951125.334952:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e0344b07c00:6509] 0 exiting: rc = 1 00000100:00100000:1.0:1783951125.335021:0:6511:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e0344b06600:6511] 2 exiting: rc = 0 00000100:00100000:3.0:1783951125.335104:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335112:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335118:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335124:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335130:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335136:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335168:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335175:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335181:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335187:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335193:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335198:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335203:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335207:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335213:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335220:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335225:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335232:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335239:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335246:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335260:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335267:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335273:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335279:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335284:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335290:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335296:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335301:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335306:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335312:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335327:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335333:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335339:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335345:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335350:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335357:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335363:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335368:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335374:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335381:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335386:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335391:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335396:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335401:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335405:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335409:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335414:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335419:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335424:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335429:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335434:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335440:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335444:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335449:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335454:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335459:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335465:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335471:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335475:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335480:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335484:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335490:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335495:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.335500:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783951125.336310:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951125.336326:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1783951125.336332:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e024770b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1783951125.336337:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024770b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1783951125.336343:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1783951125.336391:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0241aa4000 1 00000020:00000080:3.0:1783951125.336396:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f7e80 00000020:00000080:3.0:1783951125.336403:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e0241aa1800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783951125.336543:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783951125.336548:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951125.336553:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951125.336558:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9e0246b44d40) has no exports 00000020:00000080:1.0:1783951125.339602:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0241aa1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783951125.493834:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951125.493857:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783951125.493864:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e0241aa7800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783951125.493868:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0241aa7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783951125.493874:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783951125.495646:0:15814:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e0241aa6800 00000020:01000000:0.0:1783951125.495694:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783951125.495700:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951125.495705:0:15814:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951125.495709:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9e037d3219c0) has no exports 00000020:00000080:0.0:1783951125.495731:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951125.495741:0:15814:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783951125.495746:0:15814:0:(genops.c:906:class_export_put()) final put ffff9e0381194000/OSS_uuid 00000020:00000080:0.0:1783951125.495750:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0381194000/OSS_uuid for OSS 00000020:01000000:0.0:1783951125.495762:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783951125.495862:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e036d343c00:8440] 1 exiting: rc = 0 00000100:00100000:0.0:1783951125.495951:0:9851:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e0245bfa000:9851] 3 exiting: rc = 0 00000100:00100000:0.0:1783951125.496028:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e0351bb0e00:8441] 2 exiting: rc = 0 00000100:00080000:2.0:1783951125.496032:0:6521:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783951125.496323:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e037e4fda00:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1783951125.496366:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496374:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496380:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496386:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496391:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496396:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496401:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496406:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496412:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496416:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496421:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496427:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496432:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496437:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496442:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496449:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496453:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496458:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496462:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496467:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496472:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496476:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496481:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496496:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496502:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496507:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496511:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496517:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496522:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496526:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496532:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496537:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496542:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496548:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496554:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496559:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496566:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496571:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496576:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496581:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496587:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496592:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496598:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496604:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496609:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496615:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496620:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496628:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496634:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496639:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496645:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496650:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496656:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496661:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496667:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496672:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496678:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496683:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496695:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496702:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496707:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496712:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496716:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.496721:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.497560:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e037d2b5e00:8443] 1 exiting: rc = 0 00000100:00100000:2.0:1783951125.499346:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e037d2b4800:8442] 0 exiting: rc = 1 00000100:00100000:0.0:1783951125.501185:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501197:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501205:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501210:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501215:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501221:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501227:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501232:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501237:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501243:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501250:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501264:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501269:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501274:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501279:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501284:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501290:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501294:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501299:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501303:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501308:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501313:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501319:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501325:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501330:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501335:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501342:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501347:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501369:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501375:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501380:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501386:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501390:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501396:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501401:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501406:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501412:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501418:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501424:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501429:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501434:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501439:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501472:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501479:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501484:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501489:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501495:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501500:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501505:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501510:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501516:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501522:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501528:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501534:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501540:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501545:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501551:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501556:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501562:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501567:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501573:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501578:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501584:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.501599:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951125.502511:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e037e6b2200:8446] 2 exiting: rc = 0 00000100:00100000:0.0:1783951125.502511:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e037e4fd400:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1783951125.503521:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e037e6b3000:8445] 1 exiting: rc = 0 00000100:00100000:0.0:1783951125.503589:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503597:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503603:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503609:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503615:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503629:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503636:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503642:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503648:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503654:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503660:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503666:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503672:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503678:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503685:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503691:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503698:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503704:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503711:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503717:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503724:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503730:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503753:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503760:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503765:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503770:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503775:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503781:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503787:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503792:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503799:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503805:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503823:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503828:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503834:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503840:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503846:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503853:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503859:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503865:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503871:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503877:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503883:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503890:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503895:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503902:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503921:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503928:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503933:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503939:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503945:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503952:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503958:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503964:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503971:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503977:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503983:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.503989:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.504005:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.504012:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.504018:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.504024:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.504030:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951125.504036:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951125.525066:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e037e6b3e00:8447] 0 exiting: rc = 1 00000100:00100000:0.0:1783951125.534314:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e037e6b2400:8448] 1 exiting: rc = 0 00000100:00100000:1.0:1783951125.534501:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534509:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534515:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534521:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534526:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534532:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534537:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534543:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534549:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534555:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534560:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534566:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534572:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534578:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534583:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534589:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534594:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534600:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534606:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534611:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534617:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534623:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534628:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534634:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534640:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534646:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534652:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534657:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534662:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534682:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534688:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534693:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534699:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534705:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534711:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534716:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534722:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534727:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534740:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534747:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534752:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534758:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534763:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534769:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534775:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534780:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534787:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534792:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534798:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534808:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534815:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534821:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534828:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534835:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534842:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534848:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534858:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534864:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534869:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534875:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534880:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534886:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534891:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.534900:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.535624:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e037e688c00:8450] 1 exiting: rc = 0 00000100:00100000:3.0:1783951125.535720:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e0377b73200:8449] 0 exiting: rc = 1 00000100:00100000:1.0:1783951125.539853:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539863:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539869:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539875:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539882:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539888:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539894:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539900:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539918:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539924:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539929:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539946:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539952:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539958:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539964:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539969:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539975:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539980:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539986:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.539991:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540010:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540017:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540024:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540030:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540036:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540042:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540048:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540054:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540059:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540064:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540070:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540076:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540356:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540364:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540384:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540390:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540396:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540401:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540407:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540412:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540418:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540424:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540429:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540435:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540452:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540459:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540464:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540470:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540476:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540482:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540488:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540494:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540500:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540506:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540512:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540518:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540534:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540540:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540546:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540552:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540559:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540564:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540570:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951125.540576:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783951125.560520:0:15814:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783951145.207873:0:16579:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783951156.364594:0:17178:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783951156.364603:0:17178:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783951156.364604:0:17178:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783951156.364724:0:17178:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0248309800 00000020:01000004:2.0:1783951156.364740:0:17178:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783951156.364748:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783951156.364762:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e037d0a99c0) 00000020:00000080:2.0:1783951156.364776:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783951156.434380:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783951156.439341:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783951156.446403:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.447786:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.452315:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.453089:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.453482:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.453792:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.454164:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.454549:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.455087:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.455435:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.455693:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.455951:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.456308:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.456549:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.456796:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.457233:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.457548:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.457791:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.458116:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.458435:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.458682:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.458936:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.459956:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.460348:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.460548:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.460732:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.460893:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.461185:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.461519:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.461887:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.462274:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.462510:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783951156.462746:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783951156.463320:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783951156.463812:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.464378:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783951156.464633:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783951156.464877:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.465293:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.465545:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.465748:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783951156.466064:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783951156.466436:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.466672:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783951156.466871:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.470396:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783951156.470734:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783951156.472495:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783951156.476885:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783951156.477701:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783951156.478087:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1783951156.478878:0:17178:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783951156.480643:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783951156.480656:0:17178:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951156.480670:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f90c4 00000020:01000004:2.0:1783951156.480678:0:17178:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783951156.480684:0:17178:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783951156.480690:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0248309800 from MGS 00000020:01000004:2.0:1783951156.480693:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783951156.480719:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e037d0a8000) 00000020:00000080:2.0:1783951156.480729:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783951156.480794:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0248309800 from MGS, refs=2 00080000:01000000:2.0:1783951156.480799:0:17178:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783951156.480804:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f90d2 00000100:00100000:2.0:1783951156.480914:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783951156.481043:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783951156.481049:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783951156.484459:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783951156.484589:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783951156.489943:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951156.490136:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783951156.490494:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783951156.491470:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783951156.491480:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783951156.491931:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783951156.491938:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783951156.493535:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951156.493541:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951156.493544:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951156.494368:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951156.494372:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951156.494374:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951156.497326:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783951156.498713:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783951156.507250:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783951156.512261:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783951156.512338:0:17178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783951156.512391:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783951156.514410:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783951156.514721:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951156.514879:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783951156.514886:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783951156.516172:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783951156.516180:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783951156.516525:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783951156.516532:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783951156.520744:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783951156.520770:0:17178:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.133@tcp' 00000020:01000004:3.0:1783951156.520772:0:17178:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783951156.520802:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.133@tcp (typ=mgc) 00000020:00000080:3.0:1783951156.520815:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.133@tcp (ffff9e0247714d40) 00000020:00000080:3.0:1783951156.520831:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783951156.520916:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e02482ef000@MGC192.168.202.133@tcp: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951156.521067:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.133@tcp-0 is initialized 00000040:01000000:3.0:1783951156.521073:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783951156.521372:0:17195:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783951156.524608:0:17197:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783951156.524698:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.133@tcp (uuid b0a9ba1e-8c11-4522-a460-4e640633581c) 00000020:00000080:2.0:1783951156.524723:0:17178:0:(genops.c:1406:class_connect()) connect: client b0a9ba1e-8c11-4522-a460-4e640633581c, cookie 0x7645c8e1169f90e0 00000100:00080000:2.0:1783951156.525029:0:17178:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951156.525036:0:17178:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e02482ef000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951156.525070:0:17178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248337100 x1870607944944768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951156.525100:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b0a9ba1e-8c11-4522-a460-4e640633581c->MGS 00000020:01000004:2.0:1783951156.525124:0:17178:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783951156.525130:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783951156.525165:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e037d0ab380) 00000020:00000080:2.0:1783951156.525175:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783951156.526610:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0a9ba1e-8c11-4522-a460-4e640633581c:3651:1870607944944768:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783951156.526690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951156.527208:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944944768 00000100:00100000:3.0:1783951156.527220:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944944768 00000100:00100000:3.0:1783951156.527260:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951156.527268:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3651:x1870607944944768:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783951156.527298:0:17192:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b0a9ba1e-8c11-4522-a460-4e640633581c@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:3.0:1783951156.527329:0:17192:0:(genops.c:1406:class_connect()) connect: client b0a9ba1e-8c11-4522-a460-4e640633581c, cookie 0x7645c8e1169f90ee 00000100:00080000:3.0:1783951156.527463:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951156.527540:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+5:3651:x1870607944944768:12345-0@lo:250:mount.lustre.0 Request processed in 271us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951156.527548:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951156.527606:0:3651:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783951156.527618:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1783951156.527627:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783951156.527632:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783951156.527636:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783951156.527638:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783951156.527649:0:3651:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783951156.527654:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0a9ba1e-8c11-4522-a460-4e640633581c:3651:1870607944944768:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783951156.535430:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951156.535606:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951156.535612:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783951156.544785:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951156.544801:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783951156.556271:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951156.556285:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783951156.560775:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951156.560959:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783951156.560965:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783951156.565113:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783951156.565130:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783951156.612286:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951156.612489:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783951156.612495:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783951156.615319:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783951156.615339:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783951156.617432:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951156.617633:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783951156.617639:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783951156.621555:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783951156.621573:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783951156.622961:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951156.623592:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783951156.623599:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783951156.624627:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783951156.624636:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783951156.625465:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951156.625613:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783951156.625619:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783951156.628889:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783951156.628908:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783951156.654680:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951156.654876:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783951156.654883:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783951156.661706:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783951156.661721:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783951156.663730:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783951156.663745:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783951156.668751:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783951156.668779:0:17178:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783951156.668785:0:17178:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783951156.668890:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783951156.668919:0:17178:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783951156.668922:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783951156.668924:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951156.668925:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951156.668925:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951156.668926:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951156.668927:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951156.668928:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951156.668929:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951156.668930:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951156.668931:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951156.668933:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783951156.668934:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951156.668935:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951156.668935:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951156.668936:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951156.668936:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951156.668937:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951156.668938:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951156.668938:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951156.668939:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951156.668942:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951156.668964:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783951156.668995:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944944896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951156.669069:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.669113:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a69000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951156.669114:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944944896 00000100:00100000:2.0:1783951156.669121:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944944896 00000100:00100000:2.0:1783951156.669233:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951156.669243:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+5:17178:x1870607944944896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951156.669290:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783951156.669293:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783951156.669295:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783951156.672284:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783951156.676710:0:17194:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1783951156.682341:0:17216:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783951156.682351:0:17216:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783951156.682354:0:17216:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783951156.682357:0:17216:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783951156.682607:0:17216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783951156.682994:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783951156.683006:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783951156.687535:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+5:17178:x1870607944944896:12345-0@lo:253:mount.lustre.0 Request processed in 18272us (18443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.687550:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951156.687783:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944944896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951156.687798:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783951156.687801:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951156.687803:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951156.687804:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951156.687805:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951156.687806:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951156.687808:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951156.687809:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951156.687810:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951156.687812:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951156.687813:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783951156.687834:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0248309800 from lustre-MDT0000 10000000:01000000:0.0:1783951156.687867:0:17178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783951156.687870:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783951156.687875:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e0247714d40 10000000:01000000:0.0:1783951156.687878:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951156.687886:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e0247714d40 from 1 10000000:01000000:0.0:1783951156.687889:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951156.687930:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.687941:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.687949:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.687978:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951156.688027:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.688072:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951156.688585:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945024 00000100:00100000:3.0:1783951156.688592:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945024 00000100:00100000:3.0:1783951156.688647:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951156.688656:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+5:17178:x1870607944945024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951156.688669:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951156.688686:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f90fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f90f5 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.688707:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f90fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f90f5 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.688715:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f90fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f90f5 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.688733:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145a00, rc 0) 00000100:00100000:3.0:1783951156.688784:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+6:17178:x1870607944945024:12345-0@lo:101:mount.lustre.0 Request processed in 130us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951156.688790:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951156.688914:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951156.688928:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.688936:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951156.689024:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951156.689052:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.689088:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034a571cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951156.689139:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945152 00000100:00100000:2.0:1783951156.689171:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945152 00000100:00100000:2.0:1783951156.689201:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951156.689207:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+6:17178:x1870607944945152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951156.689279:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+6:17178:x1870607944945152:12345-0@lo:501:mount.lustre.0 Request processed in 71us (225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951156.689286:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951156.689399:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945152:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783951156.689428:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783951156.689449:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689457:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951156.689465:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0248309800 10000000:01000000:1.0:1783951156.689470:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783951156.689473:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e0248309800 10000000:01000000:1.0:1783951156.689476:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783951156.689479:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e0248309800 from 1 10000000:01000000:1.0:1783951156.689481:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783951156.689500:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689506:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689514:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951156.689525:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951156.689563:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.689580:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034a571cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951156.689647:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945280 00000100:00100000:2.0:1783951156.689651:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945280 00000100:00100000:2.0:1783951156.689675:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951156.689681:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+6:17178:x1870607944945280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951156.689688:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951156.689700:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343609000/0x7645c8e1169f910a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9103 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.689715:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343609000/0x7645c8e1169f910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9103 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.689723:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343609000/0x7645c8e1169f910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9103 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.689730:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609000, rc 0) 00000100:00100000:2.0:1783951156.689767:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+7:17178:x1870607944945280:12345-0@lo:101:mount.lustre.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.689773:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951156.689866:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951156.689877:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689891:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951156.689904:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783951156.689918:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689926:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951156.689931:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783951156.689935:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951156.689939:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e0248309800 10000000:01000000:1.0:1783951156.689941:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783951156.689943:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783951156.689945:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951156.689959:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689977:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.689984:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951156.689996:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951156.690021:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.690032:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034a571cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951156.690096:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945408 00000100:00100000:3.0:1783951156.690100:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945408 00000100:00100000:3.0:1783951156.690130:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951156.690136:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+7:17178:x1870607944945408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951156.690166:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951156.690176:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145000/0x7645c8e1169f9118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9111 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.690191:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145000/0x7645c8e1169f9118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9111 expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.690199:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145000/0x7645c8e1169f9118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9111 expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.690204:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145000, rc 0) 00000100:00100000:3.0:1783951156.690232:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+8:17178:x1870607944945408:12345-0@lo:101:mount.lustre.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951156.690238:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951156.690320:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951156.690332:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.690340:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951156.690385:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951156.690410:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.690437:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034a571cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951156.690510:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945536 00000100:00100000:2.0:1783951156.690514:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945536 00000100:00100000:2.0:1783951156.690534:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951156.690540:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+8:17178:x1870607944945536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951156.690671:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17178:x1870607944945536:12345-0@lo:501:mount.lustre.0 Request processed in 130us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.690677:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951156.691295:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951156.691329:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951156.691375:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.691399:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034a571cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951156.692002:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945664 00000100:00100000:2.0:1783951156.692009:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945664 00000100:00100000:2.0:1783951156.692044:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951156.692050:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17178:x1870607944945664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951156.694290:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17178:x1870607944945664:12345-0@lo:503:mount.lustre.0 Request processed in 2230us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.694302:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951156.694477:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944945664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951156.697712:0:17217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17217:1870607944945792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.697882:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951156.697979:0:17217:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036cfddcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951156.698040:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945792 00000100:00100000:0.0:1783951156.698048:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945792 00000100:00100000:0.0:1783951156.698170:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951156.698181:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17217:x1870607944945792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951156.699135:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17217:x1870607944945792:12345-0@lo:502:llog_process_th.0 Request processed in 952us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.699166:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951156.699293:0:17217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17217:1870607944945792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951156.699339:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951156.699351:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.699354:0:17217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783951156.699360:0:17217:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783951156.699364:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951156.699381:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e0247713380) 00000020:00000080:3.0:1783951156.699400:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783951156.699405:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783951156.699511:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783951156.699531:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9126 00000020:00000080:3.0:1783951156.699773:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783951156.699777:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951156.699781:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.699783:0:17217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783951156.699786:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951156.699789:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.699790:0:17217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783951156.699793:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951156.699802:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e0247710000) 00000020:00000080:3.0:1783951156.699823:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783951156.699829:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783951156.699830:0:17217:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783951156.699833:0:17217:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783951156.699840:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783951156.699896:0:17217:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0248309800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783951156.699911:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e02477119c0) 00000020:00000080:3.0:1783951156.699920:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783951156.699979:0:17217:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783951156.699986:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f913b 00000020:00000080:3.0:1783951156.700076:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783951156.700083:0:17217:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783951156.700087:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7645c8e1169f9142 00080000:01000000:3.0:1783951156.700098:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783951156.700102:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9149 00010000:00010000:3.0:1783951156.758672:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783951156.759248:0:17217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1783951156.759543:0:17217:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783951156.760126:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e036b30cd40) 00000020:00000080:3.0:1783951156.760167:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783951156.760263:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783951156.760272:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9157 00000020:00000080:3.0:1783951156.760869:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783951156.765916:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7645c8e1169f915e 00000020:00000080:3.0:1783951156.769089:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783951156.769106:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951156.769115:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.769117:0:17217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783951156.769122:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783951156.769124:0:17217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1783951156.769126:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951156.769128:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951156.769129:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783951156.769132:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.769134:0:17217:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783951156.769136:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951156.769160:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.769162:0:17217:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783951156.769168:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783951156.769217:0:17217:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783951156.769234:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951156.769238:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.769239:0:17217:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783951156.769242:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951156.769245:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.769246:0:17217:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783951156.769256:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951156.769261:0:17217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:3.0:1783951156.769286:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951156.769303:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e036b308000) 00000020:00000080:3.0:1783951156.769321:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783951156.769326:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951156.769385:0:17217:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783951156.769391:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783951156.769399:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f916c 00010000:00080000:3.0:1783951156.769431:0:17217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0377950000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951156.771124:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1783951156.774976:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951156.774997:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783951156.775049:0:17217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783951156.775077:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9173 00000100:00080000:3.0:1783951156.775092:0:17217:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951156.775100:0:17217:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0377950000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951156.775179:0:17217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860fb80 x1870607944945920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951156.775202:0:17217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783951156.775268:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951156.775272:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.775274:0:17217:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783951156.775278:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783951156.775281:0:17217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1783951156.775282:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951156.775284:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951156.775286:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783951156.775288:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.775290:0:17217:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783951156.775292:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951156.775306:0:17217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783951156.775310:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951156.775312:0:17217:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783951156.775316:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951156.775320:0:17217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:3.0:1783951156.775348:0:17217:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783951156.775351:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951156.775364:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e036b30b380) 00000020:00000080:3.0:1783951156.775378:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783951156.775384:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951156.775441:0:17217:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783951156.775448:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783951156.775454:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9181 00010000:00080000:3.0:1783951156.775500:0:17217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0350e6f000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951156.776511:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1783951156.778340:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944945920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951156.778421:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1783951156.780181:0:17217:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783951156.780532:0:17217:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783951156.782455:0:17217:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951156.782723:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:1.0:1783951156.790063:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944945920 00000100:00100000:1.0:1783951156.790080:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944945920 00000100:00100000:1.0:1783951156.790165:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951156.790174:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944945920:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1783951156.790195:0:17204:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:2.0:1783951156.794520:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783951156.795503:0:17223:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951156.795510:0:17223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783951156.796133:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951156.796294:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783951156.796337:0:17217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783951156.796362:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9188 00000100:00080000:2.0:1783951156.796374:0:17217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951156.796382:0:17217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0350e6f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951156.796425:0:17217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248337b80 x1870607944946048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951156.796445:0:17217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783951156.796547:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951156.796551:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.796553:0:17217:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783951156.796556:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951156.796559:0:17217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1783951156.796560:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951156.796562:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951156.796563:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951156.796566:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.796568:0:17217:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951156.796571:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783951156.796575:0:17217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783951156.796579:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.796580:0:17217:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783951156.796583:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951156.796597:0:17217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:2.0:1783951156.796625:0:17217:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783951156.796628:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951156.796642:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e037d0acd40) 00000020:00000080:2.0:1783951156.796655:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1783951156.796661:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951156.796724:0:17217:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783951156.796730:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783951156.796735:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9196 00010000:00080000:2.0:1783951156.796766:0:17217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0342df7000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783951156.796978:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783951156.797049:0:17217:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783951156.797085:0:17217:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783951156.797340:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944946048:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783951156.797394:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944946048 offset 0 length 520: 4 00000040:00080000:2.0:1783951156.810957:0:17217:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951156.811379:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783951156.811551:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783951156.812222:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951156.812228:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783951156.814458:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951156.814475:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783951156.814517:0:17217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783951156.814541:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f919d 00000100:00080000:2.0:1783951156.814552:0:17217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951156.814559:0:17217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0342df7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951156.814598:0:17217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248335f80 x1870607944946176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951156.814627:0:17217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783951156.814676:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951156.814680:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.814682:0:17217:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783951156.814696:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951156.814700:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.814702:0:17217:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951156.814705:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951156.814706:0:17217:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783951156.814709:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951156.814711:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.814712:0:17217:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783951156.814714:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951156.814717:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.814718:0:17217:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783951156.814722:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783951156.814756:0:17217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17217:1870607944946304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951156.815040:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944946176:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783951156.815080:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944946176 offset 0 length 520: 4 00000100:00100000:2.0:1783951156.815093:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951156.815117:0:17217:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951156.815225:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944946304 00000100:00100000:3.0:1783951156.815233:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944946304 00000100:00100000:3.0:1783951156.815279:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951156.815288:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17217:x1870607944946304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.815410:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17217:x1870607944946304:12345-0@lo:502:llog_process_th.0 Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951156.815418:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951156.815594:0:17217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17217:1870607944946304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951156.815621:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951156.815626:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951156.815629:0:17217:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783951156.815633:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783951156.815691:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783951156.815712:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783951156.815736:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.815747:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951156.815764:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0248309800 from 1 10000000:01000000:0.0:1783951156.815767:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951156.815795:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.815803:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.815893:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.815910:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951156.815942:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.815976:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951156.815997:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944946432 00000100:00100000:0.0:1783951156.816000:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944946432 00000100:00100000:0.0:1783951156.816025:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951156.816032:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+9:17178:x1870607944946432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951156.816041:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951156.816055:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f91a4 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.816075:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.816085:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.816105:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5ca00, rc 0) 00000100:00100000:0.0:1783951156.816136:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+10:17178:x1870607944946432:12345-0@lo:101:mount.lustre.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.816178:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951156.816212:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951156.816224:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.816232:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.817091:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946560:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783951156.817135:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.817666:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951156.820318:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944945920:12345-0@lo:38:llog_process_th.0 Request processed in 30136us (41889us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951156.820332:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951156.821462:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944946560 00000100:00100000:2.0:1783951156.821471:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944946560 00000100:00100000:2.0:1783951156.821526:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951156.821534:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+10:17178:x1870607944946560:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783951156.821556:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783951156.821562:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783951156.821650:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+10:17178:x1870607944946560:12345-0@lo:256:mount.lustre.0 Request processed in 116us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.821657:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783951156.821774:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951156.821779:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951156.821783:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944945920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951156.821895:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946560:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783951156.822657:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951156.822681:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.822693:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951156.822716:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0248309800 from 1 10000000:01000000:0.0:1783951156.822718:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951156.822751:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.822758:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.822768:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.822785:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951156.822838:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.822931:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951156.823057:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944946688 00000100:00100000:2.0:1783951156.823063:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944946688 00000100:00100000:2.0:1783951156.823122:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951156.823130:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+10:17178:x1870607944946688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951156.823345:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951156.823361:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f91b2 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.823387:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.823398:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.823406:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608e00, rc 0) 00000100:00100000:2.0:1783951156.823437:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17178:x1870607944946688:12345-0@lo:101:mount.lustre.0 Request processed in 309us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.823444:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951156.823515:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951156.823528:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.823536:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.823587:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951156.823609:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.823975:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951156.824052:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944946816 00000100:00100000:1.0:1783951156.824058:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944946816 00000100:00100000:1.0:1783951156.824084:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951156.824098:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17178:x1870607944946816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951156.824484:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17178:x1870607944946816:12345-0@lo:501:mount.lustre.0 Request processed in 386us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.824491:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951156.824578:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951156.824614:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951156.824657:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.824685:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034a5713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951156.824732:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944946944 00000100:00100000:0.0:1783951156.824736:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944946944 00000100:00100000:0.0:1783951156.824757:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783951156.824763:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17178:x1870607944946944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951156.824862:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17178:x1870607944946944:12345-0@lo:503:mount.lustre.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.824869:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951156.825009:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944946944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951156.825673:0:17227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17227:1870607944947072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951156.825713:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.825743:0:17227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d83540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951156.825790:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947072 00000100:00100000:0.0:1783951156.825795:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947072 00000100:00100000:0.0:1783951156.825869:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951156.825878:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17227:x1870607944947072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951156.826937:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17227:x1870607944947072:12345-0@lo:502:llog_process_th.0 Request processed in 1055us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.826947:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951156.827094:0:17227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17227:1870607944947072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951156.827125:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951156.827135:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.827137:0:17227:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783951156.827164:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0248309800 00000020:00000080:2.0:1783951156.827167:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951156.827175:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951156.827178:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.827179:0:17227:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783951156.827181:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951156.827184:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.827185:0:17227:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783951156.827188:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0248309800 00000020:00000080:2.0:1783951156.827190:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951156.827247:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951156.829044:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.829051:0:17227:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783951156.829061:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951156.829067:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951156.829072:0:17227:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783951156.829077:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0248309800 00000020:00000080:2.0:1783951156.829080:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951156.829131:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951156.830212:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951156.830219:0:17227:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951156.830227:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951156.830233:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951156.830234:0:17227:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951156.830239:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0248309800 00000020:00000080:1.0:1783951156.830241:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951156.830326:0:17227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17227:1870607944947200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951156.830407:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.830460:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947200 00000100:00100000:1.0:1783951156.830467:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947200 00000100:00100000:1.0:1783951156.830503:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951156.830512:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17227:x1870607944947200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951156.830633:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17227:x1870607944947200:12345-0@lo:502:llog_process_th.0 Request processed in 122us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951156.830641:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951156.830697:0:17227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d83e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951156.830718:0:17227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17227:1870607944947200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951156.830741:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951156.830746:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951156.830748:0:17227:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783951156.830751:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783951156.833941:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783951156.833995:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951156.834018:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.834030:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951156.834090:0:17178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951156.834093:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0248309800 10000000:01000000:0.0:1783951156.834096:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0248309800 10000000:01000000:0.0:1783951156.834101:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951156.834106:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0248309800 from 1 10000000:01000000:0.0:1783951156.834109:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951156.834169:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.834183:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.834194:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.834217:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944947328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951156.834281:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.834320:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951156.834900:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947328 00000100:00100000:1.0:1783951156.834909:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947328 00000100:00100000:1.0:1783951156.834952:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951156.834961:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17178:x1870607944947328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951156.834986:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951156.835003:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f91c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f91c0 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.835028:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f91c0 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.835039:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91c0 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.835048:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66200, rc 0) 00000100:00100000:1.0:1783951156.835098:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944947328:12345-0@lo:101:mount.lustre.0 Request processed in 136us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951156.835104:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783951156.835309:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944947328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951156.835326:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.835335:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951156.835394:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944947456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951156.835423:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.835515:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951156.835531:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947456 00000100:00100000:0.0:1783951156.835535:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947456 00000100:00100000:0.0:1783951156.835555:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951156.835561:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944947456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951156.835675:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944947456:12345-0@lo:501:mount.lustre.0 Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.835682:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951156.835722:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944947456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951156.835747:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944947584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951156.837629:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.837672:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951156.839739:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947584 00000100:00100000:1.0:1783951156.839752:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947584 00000100:00100000:1.0:1783951156.839921:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951156.839934:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944947584:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951156.840126:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944947584:12345-0@lo:503:mount.lustre.0 Request processed in 194us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951156.840160:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951156.840287:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944947584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951156.850580:0:17231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17231:1870607944947712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951156.850677:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951156.852781:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ddaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951156.855084:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947712 00000100:00100000:3.0:1783951156.855100:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947712 00000100:00100000:3.0:1783951156.855177:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783951156.855189:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17231:x1870607944947712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.855382:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17231:x1870607944947712:12345-0@lo:502:llog_process_th.0 Request processed in 195us (4705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951156.855391:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783951156.855462:0:17231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17231:1870607944947712:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783951156.855539:0:17231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783951156.855559:0:17231:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e036b3099c0) 00000020:00000080:3.0:1783951156.855578:0:17231:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1783951156.855776:0:17231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0248309800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783951156.855781:0:17231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0248309800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783951156.855783:0:17231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0248309800 4 00010000:00080000:3.0:1783951156.855826:0:17231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e037e5d9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951156.857392:0:17231:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1783951156.857489:0:17231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783951156.857526:0:17231:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783951156.857538:0:17231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7645c8e1169f91d5 00000100:00080000:3.0:1783951156.857548:0:17231:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951156.857552:0:17231:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e037e5d9800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951156.857586:0:17231:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860dc00 x1870607944947840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951156.863975:0:17231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783951156.864948:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944947840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951156.865062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951156.865772:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947840 00000100:00100000:2.0:1783951156.865783:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947840 00000100:00100000:2.0:1783951156.865881:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951156.865888:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944947840:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951156.865956:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944947840:12345-0@lo:38:llog_process_th.0 Request processed in 67us (893us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783951156.865962:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951156.866996:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951156.867006:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951156.867011:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783951156.867015:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944947840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951156.868555:0:17231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17231:1870607944947968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.868639:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951156.868679:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944947968 00000100:00100000:3.0:1783951156.868686:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944947968 00000100:00100000:3.0:1783951156.868726:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783951156.868733:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17231:x1870607944947968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.870071:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17231:x1870607944947968:12345-0@lo:502:llog_process_th.0 Request processed in 1333us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951156.870082:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783951156.870171:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347ac4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951156.870202:0:17231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17231:1870607944947968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.870261:0:17231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17231:1870607944948096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951156.870306:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951156.870330:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347ac4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951156.872375:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948096 00000100:00100000:0.0:1783951156.872387:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948096 00000100:00100000:0.0:1783951156.872470:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951156.872481:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17231:x1870607944948096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951156.872640:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17231:x1870607944948096:12345-0@lo:502:llog_process_th.0 Request processed in 160us (2332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951156.872648:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951156.872780:0:17231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0a9ba1e-8c11-4522-a460-4e640633581c:17231:1870607944948096:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783951156.872827:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783951156.873132:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783951156.873181:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951156.873200:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951156.873211:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783951156.873269:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783951156.873272:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951156.873273:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951156.873274:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951156.873276:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951156.873277:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951156.873279:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951156.873280:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951156.873282:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951156.873283:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951156.873286:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783951156.873289:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951156.873290:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951156.873291:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951156.873292:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951156.873294:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951156.873295:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951156.873296:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951156.873297:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951156.873298:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951156.873299:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951156.873320:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783951156.873337:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944948224:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951156.873379:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951156.873407:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951156.873485:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948224 00000100:00100000:3.0:1783951156.873490:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948224 00000100:00100000:3.0:1783951156.873526:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951156.873534:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944948224:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951156.873557:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783951156.873570:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783951156.877995:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951156.878018:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783951156.878337:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17178:x1870607944948224:12345-0@lo:253:mount.lustre.0 Request processed in 4799us (4953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951156.878349:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1783951156.878534:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783951156.878539:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783951156.878561:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.878577:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.878585:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.878635:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.878662:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 11 pid: 17193 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951156.878675:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944948352:0@lo:104: 00000100:00100000:3.0:1783951156.878710:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951156.878753:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347ac4540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951156.878908:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948352 00000100:00100000:1.0:1783951156.878916:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948352 00000100:00100000:1.0:1783951156.878974:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951156.878982:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944948352:12345-0@lo:104: 00010000:00010000:1.0:1783951156.878994:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951156.879039:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951156.879045:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944948352:12345-0@lo:104: Request processed in 64us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951156.879051:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951156.880131:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17178:1870607944948224:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951156.880168:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783951156.880172:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951156.880174:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951156.880175:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951156.880176:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951156.880178:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951156.880179:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951156.880181:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951156.880182:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951156.880191:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951156.880193:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783951156.880207:0:17178:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783951156.881909:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951156.881921:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.881932:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951156.881937:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.881947:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951156.881955:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951156.881961:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951156.882024:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.882031:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951156.882057:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.882064:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d800/0x7645c8e1169f91a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91ab expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.882095:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951156.882096:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951156.882098:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951156.882133:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951156.882180:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944948480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951156.882242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951156.882309:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944948352:0@lo:104: 00010000:00010000:3.0:1783951156.882330:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951156.883753:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948480 00000100:00100000:2.0:1783951156.883765:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948480 00010000:00010000:2.0:1783951156.883804:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 12 pid: 17193 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951156.883855:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951156.883867:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:3655:x1870607944948480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951156.883883:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951156.883888:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 12 pid: 17193 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.883903:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 12 pid: 17193 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.883922:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f91ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f91a4 expref: 12 pid: 17193 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.883940:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.883976:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951156.883996:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005457501s 00010000:00010000:2.0:1783951156.884003:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884010:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884021:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884028:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884034:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951156.884041:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884049:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884066:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951156.884078:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951156.884139:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+11:3655:x1870607944948480:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951156.884167:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951156.884347:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944948480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951156.884378:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.884387:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951156.884394:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783951156.910000:0:17178:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783951156.910439:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783951156.910759:0:17240:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951156.911042:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783951156.911531:0:17240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951156.913492:0:17240:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783951156.913582:0:17240:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:2.0:1783951156.913888:0:17239:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1783951156.913894:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:2.0:1783951156.914342:0:17241:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e0248335880 x1870607944948608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951156.914355:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000040:01000000:1.0:1783951156.914767:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783951156.914821:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783951156.915273:0:17178:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783951156.915281:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783951156.915327:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951156.916664:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783951156.917344:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783951156.917382:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1783951156.919374:0:17178:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1783951156.921381:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783951156.923382:0:17178:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783951156.923420:0:17178:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb8e801c7b988 00100000:10000000:1.0:1783951156.923428:0:17178:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783951156.925098:0:17178:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951156.925117:0:17178:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951156.925133:0:17178:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783951156.925177:0:17178:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783951156.932950:0:17178:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951156.933215:0:17178:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951157.536364:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951157.920455:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000040:00080000:2.0:1783951157.921813:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1783951158.048270:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951158.048280:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0248309800 from 7 10000000:01000000:1.0:1783951158.048285:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951158.048342:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951158.048355:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951158.048365:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951158.048405:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944948736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951158.048475:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951158.048557:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951158.048744:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948736 00000100:00100000:3.0:1783951158.048765:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948736 00000100:00100000:3.0:1783951158.048828:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951158.048838:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+11:17197:x1870607944948736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951158.048853:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951158.048867:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f91e3 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951158.048890:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951158.048899:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951158.048908:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145c00, rc 0) 00000100:00100000:3.0:1783951158.048965:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17197:x1870607944948736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951158.048972:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951158.049165:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944948736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951158.049180:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951158.049190:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951158.049244:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944948864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783951158.049275:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951158.049305:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951158.049420:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948864 00000100:00100000:3.0:1783951158.049425:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948864 00000100:00100000:3.0:1783951158.049455:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951158.049462:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17197:x1870607944948864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951158.049477:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951158.049492:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951158.049496:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783951158.049593:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17197:x1870607944948864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951158.049600:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951158.050687:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944948864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951158.050746:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951158.050755:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951158.050765:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951158.560328:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951158.948059:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000040:00080000:3.0:1783951158.948936:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951159.589818:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951159.970465:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:3.0:1783951160.609376:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951160.993242:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000001:02000400:2.0:1783951161.369668:0:17484:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783951161.635981:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951161.960350:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783951161.960359:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783951161.960362:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951161.960370:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 512 00000100:00100000:3.0:1783951161.960378:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944948992:0@lo:400:kworker.0 00000100:00080000:2.0:1783951161.960389:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951161.960397:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0377950000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951161.960421:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248335500 x1870607944949120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951161.960435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951161.960438:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951161.960441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951161.960444:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951161.960445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951161.960447:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783951161.960450:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951161.960452:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951161.960456:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e037e5d9800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951161.960482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248334700 x1870607944949248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951161.960525:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948992 00000100:00100000:3.0:1783951161.960532:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948992 00000100:00100000:3.0:1783951161.960591:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951161.960600:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:3655:x1870607944948992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951161.960645:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+12:3655:x1870607944948992:12345-0@lo:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951161.960652:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951161.960693:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944948992:0@lo:400:kworker.0 00000100:00100000:0.0:1783951161.960715:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949120:0@lo:38:kworker.0 00000100:00100000:0.0:1783951161.960769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951161.960800:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944949248:0@lo:38:kworker.0 00000100:00100000:0.0:1783951161.960824:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951161.960939:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944949120 00000100:00100000:2.0:1783951161.960944:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944949120 00000100:00100000:2.0:1783951161.960969:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951161.960974:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607944949120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951161.960993:0:17205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951161.961124:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944949248 00000100:00100000:3.0:1783951161.961128:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944949248 00000100:00100000:3.0:1783951161.961169:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951161.961174:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607944949248:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783951161.961190:0:17201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:3.0:1783951161.961224:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7645c8e1169f91f1 00000004:00100000:3.0:1783951161.961241:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951161.961384:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951161.961425:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1870607944949248:12345-0@lo:38:kworker.0 Request processed in 249us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951161.961432:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783951161.961896:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0248334700 x1870607944949248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951161.961910:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783951161.961931:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783951161.961937:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951161.961939:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951161.961945:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944949248:0@lo:38:kworker.0 00000100:00100000:2.0:1783951162.000396:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607944949120:12345-0@lo:38:kworker.0 Request processed in 39413us (39620us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951162.000409:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783951162.000465:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951162.000470:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951162.000481:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949120:0@lo:38:kworker.0 00000100:00100000:2.0:1783951162.016520:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000020:00000004:0.0:1783951162.335948:0:17536:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951162.336170:0:17536:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951162.658345:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951163.045295:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000020:00000004:2.0:1783951163.273808:0:17586:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951163.274010:0:17586:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951163.680723:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951164.066736:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:3.0:1783951164.706167:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951165.088460:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:1.0:1783951165.731401:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951166.052328:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951156/real 1783951156] req@ffff9e0248335f80 x1870607944946176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951166.052363:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e0248335f80 x1870607944946176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951166.052374:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951156/real 1783951156] req@ffff9e0248337b80 x1870607944946048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951166.052387:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e0248337b80 x1870607944946048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951166.052406:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951166.052432:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783951166.052437:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944946176:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783951166.052442:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951166.052461:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783951166.052464:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944946048:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783951166.052686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783951166.052699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783951166.052702:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951166.052707:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1783951166.052712:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951166.052719:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0377950000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951166.052739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860fb80 x1870607944949504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951166.052754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951166.052757:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783951166.052758:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951166.052762:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1783951166.052764:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951166.052767:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0350e6f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951166.052778:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860d180 x1870607944949632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951166.052786:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951166.052789:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783951166.052791:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951166.052794:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1783951166.052796:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951166.052799:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0342df7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951166.052808:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860f100 x1870607944949760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951166.052858:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944949888:0@lo:400:kworker.0 00000100:00100000:3.0:1783951166.052944:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951166.053001:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951166.053007:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944949376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951166.053038:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951166.053083:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944949888 00000100:00100000:3.0:1783951166.053091:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944949888 00000100:00100000:3.0:1783951166.053136:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951166.053170:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951166.053222:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944949888:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951166.053229:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951166.053251:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944949376 00000100:00100000:3.0:1783951166.053254:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944949376 00000100:00100000:3.0:1783951166.053277:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951166.053284:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:3653:x1870607944949376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951166.053313:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:3653:x1870607944949376:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951166.053320:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951166.053352:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949504:0@lo:38:kworker.0 00000100:00100000:3.0:1783951166.053395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951166.053416:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949632:0@lo:8:kworker.0 00000400:00000100:3.0:1783951166.053434:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944949632 offset 0 length 520: 4 00000100:00100000:3.0:1783951166.054799:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949760:0@lo:8:kworker.0 00000400:00000100:3.0:1783951166.054848:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944949760 offset 0 length 520: 4 00000100:00100000:3.0:1783951166.055082:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944949504 00000100:00100000:3.0:1783951166.055099:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944949504 00000100:00100000:3.0:1783951166.055135:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951166.055158:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944949504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951166.055175:0:17204:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951166.070274:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944949376:0@lo:400:kworker.0 00010000:00080000:2.0:1783951166.070304:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e024860d880 x1870607944949888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951166.070317:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944949888:0@lo:400:kworker.0 00000100:00100000:3.0:1783951166.080832:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607944949504:12345-0@lo:38:kworker.0 Request processed in 25680us (27427us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951166.080846:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783951166.081045:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951166.081051:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951166.081055:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949504:0@lo:38:kworker.0 00000100:00100000:2.0:1783951166.112281:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:3.0:1783951166.757331:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951167.138045:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:1.0:1783951167.776393:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951168.160264:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000040:00080000:1.0:1783951168.160845:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783951168.800578:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951169.186947:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:1.0:1783951169.824416:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951170.208492:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000020:01000004:1.0:1783951170.469032:0:17931:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783951170.469045:0:17931:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783951170.469047:0:17931:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783951170.469212:0:17931:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e024667e000 00000020:01000004:1.0:1783951170.469230:0:17931:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1783951170.469243:0:17931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783951170.469259:0:17931:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e0246b40000) 00000020:00000080:1.0:1783951170.469279:0:17931:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783951170.589919:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783951170.590383:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.593987:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1783951170.594226:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1783951170.594439:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.594929:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.595120:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.595452:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.595882:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.596427:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.599242:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.599960:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783951170.605499:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.609393:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.609998:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.611019:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.611397:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.611968:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.612228:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.612559:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.613569:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.615044:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.616216:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.616620:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.617001:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.617225:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.617909:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.618167:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.618486:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.618938:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.619195:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.621236:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.621876:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783951170.622998:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783951170.623947:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1783951170.624176:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783951170.624438:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1783951170.625208:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783951170.626138:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783951170.626571:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783951170.627190:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783951170.627589:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1783951170.628098:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783951170.632086:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783951170.633857:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783951170.634391:0:17931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1783951170.635645:0:17931:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783951170.635899:0:17931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783951170.635912:0:17931:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951170.635925:0:17931:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f91ff 00000020:01000004:2.0:1783951170.635934:0:17931:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783951170.635957:0:17931:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783951170.635968:0:17931:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783951170.635975:0:17931:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783951170.636004:0:17931:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783951170.636008:0:17931:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783951170.641564:0:17931:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783951170.641606:0:17931:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1783951170.641611:0:17931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783951170.641613:0:17931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951170.641614:0:17931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951170.641616:0:17931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951170.641617:0:17931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951170.641618:0:17931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951170.641620:0:17931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951170.641622:0:17931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951170.641623:0:17931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951170.641627:0:17931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1783951170.641629:0:17931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951170.641820:0:17931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951170.641821:0:17931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951170.641822:0:17931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951170.641823:0:17931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951170.641825:0:17931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951170.641826:0:17931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951170.641827:0:17931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951170.641828:0:17931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783951170.641882:0:17931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783951170.641904:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783951170.641977:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.642073:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.642209:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950016 00000100:00100000:3.0:1783951170.642218:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950016 00000100:00100000:3.0:1783951170.642383:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951170.642395:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17931:x1870607944950016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951170.642428:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783951170.642431:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1783951170.642438:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783951170.642918:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17931:x1870607944950016:12345-0@lo:253:mount.lustre.0 Request processed in 524us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.642927:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951170.643008:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783951170.643020:0:17931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783951170.643023:0:17931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951170.643025:0:17931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951170.643026:0:17931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951170.643027:0:17931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951170.643037:0:17931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951170.643038:0:17931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951170.643040:0:17931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951170.643041:0:17931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951170.643042:0:17931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783951170.643063:0:17931:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e024667e000 from lustre-MDT0001 10000000:01000000:2.0:1783951170.643092:0:17931:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783951170.643096:0:17931:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783951170.643103:0:17931:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e0247714d40 local copy 00010000:00010000:2.0:1783951170.643113:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951170.643230:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951170.643259:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.643788:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951170.644016:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950144 00000100:00100000:0.0:1783951170.644023:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950144 00000100:00100000:0.0:1783951170.644058:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951170.644066:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17931:x1870607944950144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951170.644193:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17931:x1870607944950144:12345-0@lo:501:mount.lustre.0 Request processed in 127us (932us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951170.644201:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783951170.645353:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950144:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783951170.645378:0:17931:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783951170.645412:0:17931:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783951170.645422:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.645433:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951170.645473:0:17931:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e024667e000 10000000:01000000:2.0:1783951170.645479:0:17931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783951170.645484:0:17931:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e0247714d40 10000000:01000000:2.0:1783951170.645487:0:17931:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783951170.645490:0:17931:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e0247714d40 from 1 10000000:01000000:2.0:1783951170.645493:0:17931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783951170.645528:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.645545:0:17931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.645556:0:17931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951170.645575:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951170.645623:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.645669:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951170.646188:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950272 00000100:00100000:0.0:1783951170.646194:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950272 00000100:00100000:0.0:1783951170.646229:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783951170.646238:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+12:17931:x1870607944950272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951170.646251:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951170.646266:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5d400/0x7645c8e1169f920d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9206 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.646302:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5d400/0x7645c8e1169f920d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9206 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.646312:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5d400/0x7645c8e1169f920d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9206 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.646321:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d400, rc 0) 00000100:00100000:0.0:1783951170.646365:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+13:17931:x1870607944950272:12345-0@lo:101:mount.lustre.0 Request processed in 129us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951170.646372:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783951170.646565:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951170.646580:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.646587:0:17931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951170.646603:0:17931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783951170.646614:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.646620:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951170.646785:0:17931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e024667e000 10000000:01000000:2.0:1783951170.646791:0:17931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783951170.646796:0:17931:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e024667e000 from 1 10000000:01000000:2.0:1783951170.646798:0:17931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783951170.646824:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.646846:0:17931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.646855:0:17931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951170.646870:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951170.646902:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.646927:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.647033:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950400 00000100:00100000:3.0:1783951170.647038:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950400 00000100:00100000:3.0:1783951170.647066:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951170.647072:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+13:17931:x1870607944950400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951170.647079:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951170.647088:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145800/0x7645c8e1169f921b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9214 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.647102:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145800/0x7645c8e1169f921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9214 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.647121:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145800/0x7645c8e1169f921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9214 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.647128:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145800, rc 0) 00000100:00100000:3.0:1783951170.647192:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+14:17931:x1870607944950400:12345-0@lo:101:mount.lustre.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.647198:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951170.647401:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951170.647414:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.647422:0:17931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951170.647435:0:17931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783951170.647440:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.647447:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951170.647453:0:17931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783951170.647456:0:17931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951170.647568:0:17931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e024667e000 10000000:01000000:2.0:1783951170.647579:0:17931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783951170.647583:0:17931:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783951170.647585:0:17931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951170.647601:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.647608:0:17931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.647615:0:17931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951170.647627:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951170.647851:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.647880:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.647931:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950528 00000100:00100000:3.0:1783951170.647936:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950528 00000100:00100000:3.0:1783951170.647965:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951170.647972:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+14:17931:x1870607944950528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951170.647979:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951170.647989:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145200/0x7645c8e1169f9229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9222 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.648003:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145200/0x7645c8e1169f9229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9222 expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.648012:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145200/0x7645c8e1169f9229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9222 expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.648020:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145200, rc 0) 00000100:00100000:3.0:1783951170.648056:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950528:12345-0@lo:101:mount.lustre.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.648062:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951170.648183:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951170.648195:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.648203:0:17931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951170.650346:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1783951170.653646:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951170.662299:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783951170.662366:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1783951170.662385:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1783951170.662402:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1783951170.662421:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1783951170.662434:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1783951170.662449:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1783951170.662537:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1783951170.662557:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1783951170.662572:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1783951170.662587:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1783951170.662603:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1783951170.662620:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1783951170.663048:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1783951170.663073:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1783951170.663089:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1783951170.663104:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1783951170.663119:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1783951170.663136:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1783951170.663230:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1783951170.663244:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1783951170.663260:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1783951170.663274:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1783951170.663308:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1783951170.663315:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1783951170.663431:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951170.664436:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951170.664573:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950656 00000100:00100000:1.0:1783951170.664581:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950656 00000100:00100000:1.0:1783951170.664651:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951170.664662:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951170.665058:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950656:12345-0@lo:501:mount.lustre.0 Request processed in 398us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.665068:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783951170.665578:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951170.665605:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951170.665833:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951170.665904:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.665930:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951170.665986:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950784 00000100:00100000:1.0:1783951170.666000:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950784 00000100:00100000:1.0:1783951170.666037:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951170.666045:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951170.667072:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950784:12345-0@lo:503:mount.lustre.0 Request processed in 1024us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.667081:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951170.667216:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951170.668025:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951170.668110:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951170.668198:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.668226:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951170.668298:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944950912 00000100:00100000:1.0:1783951170.668304:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944950912 00000100:00100000:1.0:1783951170.668346:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951170.668353:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951170.669223:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944950912:12345-0@lo:502:mount.lustre.0 Request processed in 867us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.669232:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951170.669536:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944950912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951170.669940:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783951170.669979:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1783951170.669997:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1783951170.670012:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1783951170.670028:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1783951170.670043:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1783951170.670060:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1783951170.670076:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1783951170.670091:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1783951170.670107:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1783951170.670124:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1783951170.670176:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1783951170.670198:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1783951170.670212:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1783951170.670227:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1783951170.670242:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1783951170.670258:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1783951170.670276:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1783951170.670359:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1783951170.670377:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1783951170.670391:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1783951170.670407:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1783951170.670421:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1783951170.670435:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1783951170.670450:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1783951170.670533:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1783951170.670553:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1783951170.670567:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1783951170.670594:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1783951170.670610:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1783951170.670624:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1783951170.670881:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1783951170.670901:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1783951170.670915:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1783951170.670930:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1783951170.670943:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1783951170.670958:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1783951170.670972:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1783951170.670987:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1783951170.671003:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1783951170.671019:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1783951170.671034:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1783951170.671048:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1783951170.671064:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1783951170.671107:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944951040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951170.671341:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.671375:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951170.671439:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944951040 00000100:00100000:1.0:1783951170.671446:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944951040 00000100:00100000:1.0:1783951170.671512:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951170.671521:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944951040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951170.671627:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944951040:12345-0@lo:502:mount.lustre.0 Request processed in 107us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.671649:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783951170.672131:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944951040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951170.672211:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1783951170.672221:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1783951170.673239:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951170.673253:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.673255:0:17935:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783951170.673265:0:17935:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783951170.673268:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951170.673296:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e0246b419c0) 00000020:00000080:1.0:1783951170.673319:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1783951170.673326:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783951170.673421:0:17935:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951170.673429:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9237 00000020:00000080:1.0:1783951170.674124:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783951170.674131:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951170.674136:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.674138:0:17935:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783951170.674183:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951170.674189:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.674190:0:17935:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783951170.674194:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951170.674204:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e0246b43380) 00000020:00000080:1.0:1783951170.674218:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1783951170.674222:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783951170.674224:0:17935:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783951170.674226:0:17935:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783951170.674233:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783951170.674292:0:17935:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e024667e000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783951170.674307:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e0246b44d40) 00000020:00000080:1.0:1783951170.674317:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1783951170.674383:0:17935:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783951170.674390:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f924c 00000020:00000080:3.0:1783951170.675455:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1783951170.675478:0:17935:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783951170.675488:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7645c8e1169f9253 00080000:01000000:3.0:1783951170.675496:0:17935:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783951170.675500:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f925a 00010000:00010000:2.0:1783951170.790344:0:17935:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1783951170.790915:0:17935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1783951170.791280:0:17935:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783951170.792343:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1783951170.792355:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951170.792360:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.792363:0:17935:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1783951170.792372:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951170.792379:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.792380:0:17935:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1783951170.792384:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951170.792388:0:17935:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:3.0:1783951170.792418:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951170.792441:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e036c2e19c0) 00000020:00000080:3.0:1783951170.792577:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1783951170.792585:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951170.792655:0:17935:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1783951170.792662:0:17935:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783951170.792670:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9268 00010000:00080000:3.0:1783951170.792773:0:17935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246ae6800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951170.795199:0:17935:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1783951170.796243:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783951170.796256:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783951170.796294:0:17935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783951170.796317:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f926f 00000100:00080000:1.0:1783951170.796329:0:17935:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951170.796335:0:17935:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e0246ae6800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951170.796370:0:17935:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02479c7800 x1870607944951168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951170.796408:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944951168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951170.796555:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951170.796642:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944951168 00000100:00100000:1.0:1783951170.796649:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944951168 00000100:00100000:1.0:1783951170.796758:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951170.796766:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607944951168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783951170.796789:0:17205:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1783951170.796821:0:17205:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9276 00000004:00100000:1.0:1783951170.796834:0:17205:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783951170.796852:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1783951170.796923:0:17935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783951170.796949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783951170.796954:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783951170.796956:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951170.796962:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1783951170.796966:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783951170.796971:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0377950000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951170.796999:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02479c5500 x1870607944951296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951170.797013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.797016:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951170.797019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.797021:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951170.797055:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944951296:0@lo:38:kworker.0 00000100:00100000:1.0:1783951170.797087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783951170.797167:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951170.797177:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.797178:0:17935:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1783951170.797182:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783951170.797185:0:17935:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783951170.797186:0:17935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951170.797188:0:17935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951170.797189:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783951170.797192:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.797194:0:17935:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783951170.797196:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951170.797200:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.797201:0:17935:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1783951170.797201:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944951424:0@lo:400:kworker.0 00000020:00000080:1.0:1783951170.797205:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783951170.797232:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:1.0:1783951170.797245:0:17935:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783951170.797260:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951170.797263:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.797264:0:17935:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1783951170.797265:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944951424 00000020:01000000:1.0:1783951170.797267:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783951170.797269:0:17935:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000100:00100000:0.0:1783951170.797269:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944951424 00000020:01000000:1.0:1783951170.797270:0:17935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951170.797271:0:17935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951170.797273:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783951170.797274:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.797276:0:17935:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783951170.797278:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951170.797281:0:17935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783951170.797284:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.797286:0:17935:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783951170.797288:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783951170.797292:0:17935:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000100:00100000:0.0:1783951170.797298:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951170.797303:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944951424:12345-0@lo:400:kworker.0 00000020:01000000:1.0:1783951170.797314:0:17935:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783951170.797317:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951170.797335:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e0371853380) 00000020:00000080:1.0:1783951170.797349:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00100000:0.0:1783951170.797352:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607944951424:12345-0@lo:400:kworker.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000020:00000080:1.0:1783951170.797358:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1783951170.797359:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783951170.797394:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e02479c5f80 x1870607944951424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951170.797407:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607944951424:0@lo:400:kworker.0 00000004:00080000:1.0:1783951170.797408:0:17935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1783951170.797414:0:17935:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783951170.797419:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9284 00010000:00080000:1.0:1783951170.797456:0:17935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e037e6de000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.133@tcp at head 00000100:00100000:3.0:1783951170.797573:0:17204:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783951170.797582:0:17204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:1.0:1783951170.798000:0:17935:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1783951170.800041:0:17935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951170.800751:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1783951170.802882:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944951296 00000100:00100000:1.0:1783951170.802894:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944951296 00000100:00100000:0.0:1783951170.803740:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951170.803750:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1870607944951296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783951170.803852:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1870607944951296:12345-0@lo:38:kworker.0 Request processed in 101us (6762us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783951170.803859:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951170.804134:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951170.804161:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951170.804166:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951170.804170:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944951296:0@lo:38:kworker.0 00000100:00080000:1.0:1783951170.804549:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951170.804608:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607944951168:12345-0@lo:38:llog_process_th.0 Request processed in 7841us (8053us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.804615:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951170.804760:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951170.804767:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783951170.804774:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783951170.804779:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951170.804782:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951170.804798:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944951168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951170.804916:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944951552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951170.804954:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951170.805670:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944951552 00000100:00100000:1.0:1783951170.805677:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944951552 00000100:00100000:1.0:1783951170.805732:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951170.805740:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944951552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951170.805771:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000040:00080000:3.0:1783951170.808332:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951170.808674:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783951170.808875:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1783951170.809242:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944951552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3497us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.809254:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951170.809454:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944951552:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783951170.810482:0:17941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951170.810487:0:17941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783951170.811395:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783951170.811409:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783951170.811449:0:17935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783951170.811541:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f928b 00000100:00080000:3.0:1783951170.811553:0:17935:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951170.811559:0:17935:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e037e6de000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951170.811591:0:17935:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860f480 x1870607944951680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951170.811646:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944951680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783951170.811768:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944951680 offset 0 length 520: 4 00000100:00080000:3.0:1783951170.811821:0:17935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783951170.811903:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951170.811908:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.811909:0:17935:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783951170.811921:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783951170.811923:0:17935:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1783951170.811925:0:17935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951170.811927:0:17935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951170.811929:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783951170.811931:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.811933:0:17935:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783951170.811935:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951170.811939:0:17935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783951170.811942:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.811943:0:17935:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783951170.811946:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951170.811949:0:17935:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:3.0:1783951170.811973:0:17935:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783951170.811976:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951170.811987:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e036c2e3380) 00000020:00000080:3.0:1783951170.812001:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783951170.812005:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951170.812063:0:17935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783951170.812070:0:17935:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783951170.812076:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9299 00010000:00080000:3.0:1783951170.812108:0:17935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0380fb7000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951170.812340:0:17935:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783951170.812407:0:17935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783951170.812424:0:17935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1783951170.813047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.813054:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951170.813066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.813069:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1783951170.816829:0:17935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951170.817499:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783951170.817646:0:17935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783951170.818204:0:17943:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783951170.818210:0:17943:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783951170.819086:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783951170.819102:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783951170.819198:0:17935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783951170.819225:0:17935:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f92a0 00000100:00080000:3.0:1783951170.819238:0:17935:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951170.819245:0:17935:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0380fb7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951170.819296:0:17935:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860ea00 x1870607944951808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951170.819898:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944951808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783951170.819973:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944951808 offset 0 length 520: 4 00000100:00080000:3.0:1783951170.820616:0:17935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783951170.820744:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951170.820750:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.820752:0:17935:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783951170.820755:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951170.820760:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.820761:0:17935:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783951170.820764:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783951170.820766:0:17935:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783951170.820769:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951170.820771:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.820773:0:17935:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783951170.820775:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951170.820777:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.820779:0:17935:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783951170.820782:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783951170.820816:0:17935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951170.820818:0:17935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951170.820820:0:17935:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783951170.820823:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1783951170.821201:0:17931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1783951170.821232:0:17931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783951170.821247:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.821259:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951170.821266:0:17931:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e024667e000 from 1 10000000:01000000:0.0:1783951170.821269:0:17931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951170.821302:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.821310:0:17931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.821321:0:17931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951170.821341:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944951936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951170.821393:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.821424:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b313780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.821592:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944951936 00000100:00100000:3.0:1783951170.821599:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944951936 00000100:00100000:3.0:1783951170.821661:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783951170.821672:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+15:17931:x1870607944951936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951170.821933:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951170.821956:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f92a7 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.821980:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.821990:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.821999:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145e00, rc 0) 00000100:00100000:3.0:1783951170.822123:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17931:x1870607944951936:12345-0@lo:101:mount.lustre.0 Request processed in 453us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.822130:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783951170.822232:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944951936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951170.822248:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.822257:0:17931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951170.822912:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952064:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783951170.822956:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783951170.823097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.823103:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951170.823105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.823108:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951170.823254:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b313780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.823517:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952064 00000100:00100000:3.0:1783951170.823524:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952064 00000100:00100000:3.0:1783951170.823564:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783951170.823571:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17931:x1870607944952064:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783951170.823588:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783951170.823607:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783951170.823610:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783951170.823706:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17931:x1870607944952064:12345-0@lo:256:mount.lustre.0 Request processed in 135us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.823713:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783951170.823921:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952064:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783951170.824947:0:17931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951170.825024:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.825040:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951170.825372:0:17931:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e024667e000 from 1 10000000:01000000:2.0:1783951170.825378:0:17931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951170.825417:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.825426:0:17931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.825437:0:17931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951170.825458:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951170.825611:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.825652:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951170.825772:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952192 00000100:00100000:0.0:1783951170.825779:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952192 00000100:00100000:0.0:1783951170.825870:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783951170.825880:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17931:x1870607944952192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951170.825892:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951170.825906:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f92b5 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.825929:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.825941:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.825950:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951170.826007:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952192:12345-0@lo:101:mount.lustre.0 Request processed in 128us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951170.826127:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951170.826161:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.826171:0:17931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951170.826296:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951170.826327:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951170.826353:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.826490:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951170.826655:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951170.826778:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952320 00000100:00100000:0.0:1783951170.826783:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952320 00000100:00100000:0.0:1783951170.826801:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783951170.826807:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951170.826944:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952320:12345-0@lo:501:mount.lustre.0 Request processed in 136us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951170.826951:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783951170.827054:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951170.827089:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951170.827129:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.827169:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.827337:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952448 00000100:00100000:3.0:1783951170.827342:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952448 00000100:00100000:3.0:1783951170.827364:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951170.827371:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951170.827526:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952448:12345-0@lo:503:mount.lustre.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.827541:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951170.827657:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783951170.828313:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951170.828407:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951170.828457:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.828797:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952576 00000100:00100000:3.0:1783951170.828804:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952576 00000100:00100000:3.0:1783951170.828856:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951170.828863:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951170.828963:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952576:12345-0@lo:502:mount.lustre.0 Request processed in 100us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.828969:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951170.829254:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.829274:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951170.829542:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783951170.829577:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1783951170.829593:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1783951170.829609:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1783951170.829625:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1783951170.829642:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1783951170.829660:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1783951170.829677:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1783951170.829778:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783951170.829796:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1783951170.829815:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1783951170.830795:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951170.830952:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.831042:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951170.831295:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952704 00000100:00100000:1.0:1783951170.831304:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952704 00000100:00100000:1.0:1783951170.831393:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951170.831404:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951170.831622:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952704:12345-0@lo:502:mount.lustre.0 Request processed in 220us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.831630:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951170.831733:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951170.831821:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1783951170.831847:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783951170.832600:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951170.832610:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951170.832613:0:17945:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783951170.832621:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e024667e000 00000020:00000080:0.0:1783951170.832624:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951170.832632:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951170.832635:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951170.832636:0:17945:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783951170.832638:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951170.832640:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951170.832642:0:17945:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783951170.832645:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e024667e000 00000020:00000080:0.0:1783951170.832647:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951170.832809:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951170.832815:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951170.832816:0:17945:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783951170.832819:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951170.832828:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951170.832829:0:17945:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783951170.832833:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e024667e000 00000020:00000080:0.0:1783951170.832845:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951170.837612:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951170.837771:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.837776:0:17945:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951170.837782:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951170.837788:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.837790:0:17945:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951170.837796:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e024667e000 00000020:00000080:1.0:1783951170.837800:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951170.837909:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951170.837915:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951170.837917:0:17945:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783951170.837920:0:17945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1783951170.840792:0:17931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783951170.840865:0:17931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951170.840897:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.840910:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951170.840969:0:17931:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951170.840973:0:17931:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e024667e000 10000000:01000000:0.0:1783951170.840975:0:17931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e024667e000 10000000:01000000:0.0:1783951170.840979:0:17931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951170.840984:0:17931:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e024667e000 from 1 10000000:01000000:0.0:1783951170.840987:0:17931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951170.841180:0:17931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.841189:0:17931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.841199:0:17931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951170.841225:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951170.841292:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.841332:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b313240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951170.841414:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952832 00000100:00100000:2.0:1783951170.841422:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952832 00000100:00100000:2.0:1783951170.841481:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951170.841492:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17931:x1870607944952832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951170.841506:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951170.841520:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343609a00/0x7645c8e1169f92ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f92c3 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.841544:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343609a00/0x7645c8e1169f92ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f92c3 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.841556:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343609a00/0x7645c8e1169f92ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92c3 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951170.841566:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609a00, rc 0) 00000100:00100000:2.0:1783951170.841612:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944952832:12345-0@lo:101:mount.lustre.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951170.841621:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951170.842171:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951170.842189:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951170.842200:0:17931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951170.843601:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1783951170.843883:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951170.844199:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1783951170.844228:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1783951170.844246:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1783951170.844262:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1783951170.844278:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1783951170.844292:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1783951170.844307:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1783951170.844320:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1783951170.844335:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1783951170.844350:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1783951170.844364:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1783951170.844379:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1783951170.844394:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1783951170.844408:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1783951170.844420:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1783951170.844433:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1783951170.844448:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1783951170.844541:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1783951170.844564:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1783951170.844580:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1783951170.844594:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1783951170.844625:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1783951170.844643:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1783951170.844669:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1783951170.844683:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1783951170.844699:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1783951170.844715:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1783951170.844728:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1783951170.844751:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1783951170.844756:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783951170.844851:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951170.844917:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.844970:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b3130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.846334:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944952960 00000100:00100000:3.0:1783951170.846343:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944952960 00000100:00100000:3.0:1783951170.846403:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783951170.846412:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944952960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951170.846605:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944952960:12345-0@lo:501:mount.lustre.0 Request processed in 191us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.846615:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951170.846820:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944952960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951170.846882:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951170.846938:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.846983:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b3130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.847613:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953088 00000100:00100000:3.0:1783951170.847619:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953088 00000100:00100000:3.0:1783951170.847656:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783951170.847664:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951170.847754:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953088:12345-0@lo:503:mount.lustre.0 Request processed in 90us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.847761:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951170.847851:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951170.848879:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951170.848958:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951170.849009:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951170.849566:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951170.850585:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953216 00000100:00100000:0.0:1783951170.850593:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953216 00000100:00100000:0.0:1783951170.850642:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951170.850651:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951170.850777:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953216:12345-0@lo:502:mount.lustre.0 Request processed in 127us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951170.850785:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951170.850855:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0378f47c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951170.850884:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951170.853261:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783951170.853318:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1783951170.853333:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1783951170.853348:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1783951170.853365:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1783951170.853382:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1783951170.853415:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1783951170.853434:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1783951170.853451:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1783951170.854643:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1783951170.854673:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1783951170.854687:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1783951170.854701:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1783951170.854715:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1783951170.854729:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1783951170.854745:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1783951170.854759:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1783951170.854776:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1783951170.854791:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1783951170.854807:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1783951170.854821:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1783951170.854850:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1783951170.854885:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1783951170.854908:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1783951170.854924:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1783951170.854939:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1783951170.854955:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1783951170.854969:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1783951170.854983:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1783951170.854997:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1783951170.856547:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1783951170.856614:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1783951170.856631:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1783951170.856648:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1783951170.856664:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1783951170.856680:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1783951170.856697:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1783951170.856716:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1783951170.856750:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1783951170.856769:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1783951170.856786:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1783951170.856800:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1783951170.856816:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1783951170.856830:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1783951170.856860:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1783951170.856876:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1783951170.856893:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1783951170.856908:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1783951170.856973:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951170.858329:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.860946:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b313240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951170.865586:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953344 00000100:00100000:1.0:1783951170.865600:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953344 00000100:00100000:3.0:1783951170.871982:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783951170.871997:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951170.872230:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953344:12345-0@lo:502:mount.lustre.0 Request processed in 235us (13904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.872238:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951170.873239:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783951170.873582:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1783951170.873614:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1783951170.873652:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951170.873710:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951170.873748:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.873809:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953472 00000100:00100000:3.0:1783951170.873815:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953472 00000100:00100000:3.0:1783951170.873871:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951170.873879:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951170.873974:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953472:12345-0@lo:502:mount.lustre.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.873982:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951170.873984:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783951170.874032:0:17931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1783951170.874041:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1783951170.874889:0:17950:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1783951170.874905:0:17950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e03779599c0) 00000020:00000080:2.0:1783951170.874926:0:17950:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783951170.875090:0:17950:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e024667e000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783951170.875095:0:17950:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e024667e000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783951170.875097:0:17950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e024667e000 3 00010000:00080000:2.0:1783951170.875127:0:17950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e03438c8000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783951170.879152:0:17950:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1783951170.879272:0:17950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1783951170.879319:0:17950:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951170.879333:0:17950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7645c8e1169f92d8 00000100:00080000:2.0:1783951170.879344:0:17950:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951170.879350:0:17950:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e03438c8000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951170.879385:0:17950:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248334e00 x1870607944953600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951170.879417:0:17950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783951170.879439:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944953600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951170.879510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783951170.879579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.879591:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951170.879594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951170.879596:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951170.880246:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953600 00000100:00100000:3.0:1783951170.880253:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953600 00000100:00100000:3.0:1783951170.880287:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951170.880300:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607944953600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783951170.880325:0:17201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1783951170.880358:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7645c8e1169f92df 00000004:00100000:3.0:1783951170.880371:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951170.880398:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9e0343db6000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1783951170.880651:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1783951170.880958:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1870607944953600:12345-0@lo:38:llog_process_th.0 Request processed in 157us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.880967:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783951170.881097:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0248334e00 x1870607944953600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951170.881108:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951170.881117:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783951170.881124:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783951170.881128:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783951170.881132:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783951170.881137:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607944953600:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1783951170.881533:0:17931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783951170.881566:0:17931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783951170.881587:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.881598:0:17931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951170.881648:0:17931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783951170.881650:0:17931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783951170.881655:0:17931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951170.881656:0:17931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951170.881657:0:17931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951170.881658:0:17931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951170.881660:0:17931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951170.881661:0:17931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951170.881662:0:17931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951170.881665:0:17931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1783951170.881667:0:17931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951170.881668:0:17931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783951170.881669:0:17931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951170.881670:0:17931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951170.881671:0:17931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951170.881672:0:17931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951170.881673:0:17931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951170.881674:0:17931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951170.881675:0:17931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951170.881693:0:17931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783951170.881708:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951170.881750:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.881776:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03494e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.881791:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953728 00000100:00100000:3.0:1783951170.881795:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953728 00000100:00100000:3.0:1783951170.881832:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783951170.881850:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17931:x1870607944953728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951170.881871:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783951170.881883:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783951170.888948:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783951170.889015:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951170.889033:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1783951170.889130:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951170.889136:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783951170.889333:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.889352:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.889360:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.889367:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.889406:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.889419:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 18 pid: 17193 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951170.889433:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944953856:0@lo:104: 00000100:00100000:1.0:1783951170.889514:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951170.889576:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.889597:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951170.889606:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944953984:0@lo:104: 00000100:00100000:1.0:1783951170.889633:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951170.889658:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432ddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951170.889679:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953856 00000100:00100000:2.0:1783951170.889691:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953856 00000100:00100000:2.0:1783951170.889793:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944953984 00000100:00100000:2.0:1783951170.889798:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944953984 00000100:00100000:3.0:1783951170.889804:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951170.889823:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+4:17215:x1870607944953856:12345-0@lo:104: 00010000:00010000:3.0:1783951170.889847:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.889921:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951170.889927:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+4:17215:x1870607944953856:12345-0@lo:104: Request processed in 114us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.890076:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944953856:0@lo:104: 00010000:00010000:1.0:1783951170.890286:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951170.890292:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890300:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5de00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951170.890304:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890312:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951170.890320:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951170.890327:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951170.890358:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890364:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951170.890382:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890399:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5de00/0x7645c8e1169f92a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92ae expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890410:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951170.890412:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951170.890413:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951170.890425:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944954112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951170.890455:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951170.890507:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954112 00000100:00100000:1.0:1783951170.890511:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954112 00010000:00010000:1.0:1783951170.890529:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 19 pid: 17193 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951170.890551:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951170.890558:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3652:x1870607944954112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951170.890567:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951170.890573:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 19 pid: 17193 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890583:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 19 pid: 17193 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890598:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f92ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f92a7 expref: 19 pid: 17193 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951170.890610:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951170.890638:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3652:x1870607944954112:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951170.890653:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951170.890701:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944954112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951170.891325:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951170.891346:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951170.891354:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944953984:12345-0@lo:104: 00010000:00010000:3.0:1783951170.891366:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891421:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951170.891427:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944953984:12345-0@lo:104: Request processed in 75us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.891433:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783951170.891449:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951170.891453:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891471:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951170.891474:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891481:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951170.891487:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951170.891493:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951170.891524:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891530:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951170.891546:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891553:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f91e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891565:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951170.891567:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951170.891569:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951170.891578:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944954240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951170.891606:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.891650:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954240 00000100:00100000:3.0:1783951170.891655:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954240 00010000:00010000:3.0:1783951170.891671:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951170.891816:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944953984:0@lo:104: 00010000:00010000:1.0:1783951170.891843:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951170.891896:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951170.891904:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3653:x1870607944954240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951170.891913:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951170.891917:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891927:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891938:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145c00/0x7645c8e1169f91ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f91e3 expref: 18 pid: 17194 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891959:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891966:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951170.891980:0:17186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005457501s 00010000:00010000:3.0:1783951170.891984:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891990:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.891997:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892004:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892010:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951170.892014:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892020:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892035:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892045:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951170.892079:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:3653:x1870607944954240:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.892087:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783951170.892107:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892115:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951170.892122:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f92e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951170.892181:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944954240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951170.892241:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17931:x1870607944953728:12345-0@lo:253:mount.lustre.0 Request processed in 10391us (10489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.892251:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783951170.892287:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:17931:1870607944953728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783951170.892298:0:17931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783951170.892302:0:17931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951170.892304:0:17931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783951170.892305:0:17931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951170.892307:0:17931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951170.892309:0:17931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951170.892310:0:17931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951170.892312:0:17931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951170.892313:0:17931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951170.892315:0:17931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783951170.892327:0:17931:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1783951170.909251:0:17931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1783951170.909437:0:17957:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1783951170.909441:0:17957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783951170.909621:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783951170.909925:0:17931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1783951170.910041:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951170.910301:0:17959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1870607944954368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783951170.910371:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951170.910407:0:17959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7d3c0 going to sleep for 11 seconds 00000040:01000000:2.0:1783951170.910593:0:17931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1783951170.910639:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951170.911235:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954368 00000100:00100000:3.0:1783951170.911242:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954368 00000100:00100000:3.0:1783951170.911295:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951170.911313:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17959:x1870607944954368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.911405:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17959:x1870607944954368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.911413:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951170.911525:0:17959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1870607944954368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1783951170.911561:0:17959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783951170.911593:0:17959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1870607944954496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.911637:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.911662:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954496 00000100:00100000:3.0:1783951170.911666:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954496 00000100:00100000:3.0:1783951170.911688:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951170.911694:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17959:x1870607944954496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.911782:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17959:x1870607944954496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.911788:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951170.911807:0:17959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b313000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.911819:0:17959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1870607944954496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.911879:0:17959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17959:1870607944954624:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.911906:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.911928:0:17959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6c0c0 going to sleep for 11 seconds 00000040:00080000:1.0:1783951170.912525:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783951170.912587:0:17958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1783951170.912699:0:17931:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1783951170.912727:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954624 00000100:00100000:2.0:1783951170.912731:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954624 00000100:00100000:2.0:1783951170.912814:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951170.912821:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17959:x1870607944954624:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783951170.912878:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17959:x1870607944954624:12345-0@lo:900:lod0001_rec0000.0 Request processed in 57us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951170.912884:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1783951170.912911:0:17931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1783951170.912978:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1783951170.913582:0:17959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e024860c000 x1870607944954624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783951186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951170.913595:0:17959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17959:1870607944954624:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.913647:0:17959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1870607944954752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.913689:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951170.913715:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954752 00000100:00100000:3.0:1783951170.913719:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954752 00000100:00100000:3.0:1783951170.913745:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951170.913751:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17959:x1870607944954752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951170.913804:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17959:x1870607944954752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951170.913810:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951170.913830:0:17959:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951170.913854:0:17959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1870607944954752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1783951170.913896:0:17959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951170.916401:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783951170.917082:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783951170.917117:0:17931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1783951170.918034:0:17931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783951170.918947:0:17931:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1783951170.919547:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783951170.919611:0:17959:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783951170.919615:0:17959:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1783951170.921412:0:17931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783951170.923023:0:17931:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783951170.923055:0:17931:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb8e801c7b988 00100000:10000000:2.0:1783951170.923063:0:17931:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783951170.923928:0:17931:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951170.923959:0:17931:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951170.923977:0:17931:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783951170.923997:0:17931:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783951170.925008:0:17931:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951170.925266:0:17931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783951171.232717:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:1.0:1783951171.876574:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951171.939585:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1783951172.128271:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783951172.128283:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e024667e000 from 8 10000000:01000000:3.0:1783951172.128290:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951172.128358:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.128372:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.128384:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951172.128421:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944954880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951172.128515:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951172.128601:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951172.128671:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944954880 00000100:00100000:2.0:1783951172.128691:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944954880 00000100:00100000:2.0:1783951172.128767:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951172.128778:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17197:x1870607944954880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951172.128797:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951172.128815:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f92ed expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951172.128861:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951172.128874:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951172.128897:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608600, rc 0) 00000100:00100000:2.0:1783951172.128946:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944954880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951172.128953:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783951172.129356:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944954880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951172.129376:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.129387:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951172.129458:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944955008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951172.129498:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951172.129520:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951172.129632:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955008 00000100:00100000:2.0:1783951172.129639:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955008 00000100:00100000:2.0:1783951172.129690:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951172.129699:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944955008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951172.129718:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951172.129749:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951172.129753:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783951172.129859:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944955008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951172.129874:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783951172.130199:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944955008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783951172.130259:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951172.130269:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.130279:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951172.130290:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783951172.130293:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0248309800 from 8 10000000:01000000:3.0:1783951172.130296:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951172.130324:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.130332:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.130341:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951172.130366:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944955136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951172.130397:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951172.130419:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951172.130477:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955136 00000100:00100000:2.0:1783951172.130483:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955136 00000100:00100000:2.0:1783951172.130520:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951172.130528:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944955136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951172.130538:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951172.130552:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f92fb expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951172.130573:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951172.130584:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951172.130593:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608a00, rc 0) 00000100:00100000:2.0:1783951172.130624:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944955136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951172.130631:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783951172.130703:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944955136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951172.130715:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.130723:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951172.130773:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944955264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951172.130805:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951172.130838:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951172.131295:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955264 00000100:00100000:2.0:1783951172.131302:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955264 00000100:00100000:2.0:1783951172.131336:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951172.131344:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944955264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951172.131360:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951172.131379:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951172.131382:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783951172.131464:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944955264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951172.131480:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951172.131569:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944955264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783951172.131618:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951172.131625:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951172.131635:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951172.256258:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:3.0:1783951172.899552:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951172.965531:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951173.280263:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:1.0:1783951173.923434:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951174.305286:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00010000:00010000:3.0:1783951174.949056:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951175.328250:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 0 seconds 00000001:02000400:3.0:1783951175.956371:0:18202:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783951175.971734:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951176.288492:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944955392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951176.288575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951176.288763:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955392 00000100:00100000:3.0:1783951176.288798:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955392 00000100:00100000:3.0:1783951176.288855:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783951176.288865:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3654:x1870607944955392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783951176.289051:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783951176.289058:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783951176.289068:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951176.289076:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0377950000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951176.289102:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247b66d80 x1870607944955648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951176.289122:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951176.289126:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951176.289128:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951176.289131:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951176.289187:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951176.289191:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951176.289193:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951176.289196:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951176.289349:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944956032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951176.289548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951176.289627:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956032 00000100:00100000:1.0:1783951176.289704:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956032 00000100:00100000:1.0:1783951176.289744:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951176.289753:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944956032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951176.289808:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944956032:12345-0@lo:400:kworker.0 Request processed in 56us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951176.289816:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951176.289895:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3654:x1870607944955392:12345-0@lo:400:kworker.0 Request processed in 1031us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951176.289902:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783951176.289982:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944955520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951176.290034:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951176.290075:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944955776:0@lo:400:kworker.0 00000100:00100000:0.0:1783951176.290099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951176.290126:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951176.290132:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944955904:0@lo:400:kworker.0 00000100:00100000:0.0:1783951176.290172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951176.290259:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955776 00000100:00100000:3.0:1783951176.290263:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955776 00000100:00100000:3.0:1783951176.290300:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951176.290307:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944955776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951176.290344:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944955776:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951176.290350:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783951176.290912:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0247b65500 x1870607944955776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951176.290926:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944955776:0@lo:400:kworker.0 00000100:00100000:3.0:1783951176.291009:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955520 00000100:00100000:3.0:1783951176.291014:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955520 00000100:00100000:3.0:1783951176.291075:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955904 00000100:00100000:3.0:1783951176.291079:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955904 00000100:00100000:3.0:1783951176.291093:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951176.291100:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944955520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951176.291133:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783951176.291206:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607944955520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951176.291213:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951176.291227:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951176.291233:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944955904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951176.291264:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944955904:12345-0@lo:400:kworker.0 Request processed in 32us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951176.291279:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951176.291378:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944955520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951176.291407:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944955904:0@lo:400:kworker.0 00000100:00100000:2.0:1783951176.291721:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944955392:0@lo:400:kworker.0 00010000:00080000:2.0:1783951176.291744:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0247b66a00 x1870607944956032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951176.291754:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944956032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951176.291779:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944955648:0@lo:38:kworker.0 00000100:00100000:2.0:1783951176.291825:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951176.291950:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944955648 00000100:00100000:3.0:1783951176.291954:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944955648 00000100:00100000:3.0:1783951176.292023:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951176.292028:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1870607944955648:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783951176.292053:0:17940:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1783951176.292088:0:17940:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9309 00000004:00100000:3.0:1783951176.292103:0:17940:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783951176.292109:0:17940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783951176.301272:0:17940:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951176.301397:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607944955648:12345-0@lo:38:kworker.0 Request processed in 9365us (9569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951176.301410:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783951176.301954:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783951176.301965:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783951176.301971:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783951176.301974:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783951176.301998:0:3651:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000091c5d453): req@ffff9e0248335880 x1870607944948608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951176.302021:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944955648:0@lo:38:kworker.0 00000100:00100000:0.0:1783951176.302177:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951176.302212:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951176.302548:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944948608 00000100:00100000:2.0:1783951176.302578:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944948608 00000100:00100000:2.0:1783951176.302626:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783951176.302644:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17241:x1870607944948608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951176.302738:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17241:x1870607944948608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951176.302745:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951176.305057:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944956160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951176.305126:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951176.305276:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956160 00000100:00100000:1.0:1783951176.305285:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956160 00000100:00100000:1.0:1783951176.305342:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951176.305351:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944956160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951176.305389:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951176.305452:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944956160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951176.305477:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951176.305514:0:17241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1870607944948608:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783951176.305563:0:17241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783951176.305600:0:17241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1870607944956288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951176.305650:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951176.305691:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03431d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951176.305759:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956288 00000100:00100000:0.0:1783951176.305761:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944956160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951176.305765:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956288 00000100:00100000:1.0:1783951176.305808:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951176.305816:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1870607944956288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783951176.305933:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1870607944956288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951176.305939:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951176.305999:0:17241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1870607944956288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951176.306076:0:17241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1870607944956416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951176.306104:0:17241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951176.309423:0:17241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951176.309859:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956416 00000100:00100000:0.0:1783951176.309871:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956416 00000100:00100000:3.0:1783951176.309936:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951176.310008:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17241:x1870607944956416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951176.310222:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17241:x1870607944956416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 275us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951176.310231:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951176.310307:0:17241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1870607944956416:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783951176.310579:0:17241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951176.313230:0:17241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783951176.313329:0:17241:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1783951176.313334:0:17241:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1783951176.790422:0:18254:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951176.790640:0:18254:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951176.994420:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783951177.634118:0:18305:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783951177.634623:0:18305:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951178.016312:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951178.401000:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1783951178.606723:0:18353:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6603c4e0 20000000:00000080:3.0:1783951178.606749:0:18353:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e03718f9800 uarg=0000000000000000 20000000:01000000:3.0:1783951178.606809:0:18353:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783951178.606817:0:18353:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783951178.606823:0:18353:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783951178.611633:0:18354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1783951178.611889:0:18353:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783951178.627800:0:18353:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783951178.627836:0:18353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.627857:0:18353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.628064:0:18353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.628074:0:18353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.628136:0:18353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.628186:0:18353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 17 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951178.628202:0:18353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18353:1870607944956544:0@lo:104: 00000100:00100000:2.0:1783951178.628287:0:18353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951178.628343:0:18353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.628351:0:18353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 17 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951178.628359:0:18353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18353:1870607944956672:0@lo:104: 00000100:00100000:2.0:1783951178.628379:0:18353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951178.628392:0:18353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951178.628541:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956544 00000100:00100000:3.0:1783951178.628549:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956544 00000100:00100000:3.0:1783951178.628589:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956672 00000100:00100000:3.0:1783951178.628592:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956672 00000100:00100000:3.0:1783951178.628606:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951178.628614:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+4:18353:x1870607944956544:12345-0@lo:104: 00010000:00010000:3.0:1783951178.628626:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951178.628693:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951178.628699:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+4:18353:x1870607944956544:12345-0@lo:104: Request processed in 86us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951178.628706:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951178.628723:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951178.628737:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+3:18353:x1870607944956672:12345-0@lo:104: 00010000:00010000:3.0:1783951178.628745:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951178.628785:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783951178.628790:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+3:18353:x1870607944956672:12345-0@lo:104: Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951178.628796:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951178.628974:0:18353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18353:1870607944956544:0@lo:104: 00000100:00100000:2.0:1783951178.628982:0:18353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18353:1870607944956672:0@lo:104: 00010000:00010000:2.0:1783951178.629000:0:18353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.630860:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951178.630874:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.630885:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951178.630890:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.630899:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951178.630907:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951178.630912:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951178.630975:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.630998:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951178.631030:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.631037:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343608800/0x7645c8e1169f92b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92bc expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.631049:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951178.631052:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951178.631053:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944956800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951178.631058:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951178.631060:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.631067:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951178.631072:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951178.631076:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951178.631093:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.631098:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951178.631104:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951178.631109:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c600/0x7645c8e1169f91b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f91b9 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951178.631113:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951178.631127:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951178.631129:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951178.631130:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951178.631136:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951178.631161:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944956928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951178.631186:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951178.631230:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956800 00000100:00100000:2.0:1783951178.631237:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956800 00010000:00010000:2.0:1783951178.631264:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 18 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951178.631306:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944956928 00000100:00100000:2.0:1783951178.631310:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944956928 00010000:00010000:2.0:1783951178.631322:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 19 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951178.631329:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951178.631341:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3652:x1870607944956800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951178.631365:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951178.631370:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 19 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951178.631381:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 19 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951178.631395:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5c800/0x7645c8e1169f92bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f92b5 expref: 19 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951178.631407:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951178.631444:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3652:x1870607944956800:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951178.635853:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783951178.635883:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783951178.637189:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783951178.637217:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951178.637232:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3653:x1870607944956928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951178.637256:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951178.637267:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 18 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637283:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 18 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637302:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f91b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f91b2 expref: 18 pid: 17193 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637321:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637345:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637361:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637368:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637375:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637382:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637388:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951178.637393:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637400:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637429:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951178.637440:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951178.637522:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:3653:x1870607944956928:12345-0@lo:103:ldlm_bl.0 Request processed in 294us (6334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951178.637542:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783951178.639782:0:18353:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.639799:0:18353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951178.639806:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9310 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951178.642025:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944956800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951178.643024:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944956928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951178.643459:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783951179.041212:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951180.064410:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951180.384352:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951170/real 1783951170] req@ffff9e024860ea00 x1870607944951808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951180.384382:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e024860ea00 x1870607944951808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951180.384393:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951170/real 1783951170] req@ffff9e024860f480 x1870607944951680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951180.384403:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e024860f480 x1870607944951680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951180.384434:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951180.384459:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783951180.384464:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944951808:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783951180.384469:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951180.384474:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783951180.384477:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944951680:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783951180.384640:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951180.384650:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951180.384652:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951180.384655:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951180.384680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951180.384683:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783951180.384686:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951180.384691:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1783951180.384695:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783951180.384703:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e037e6de000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951180.384722:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247b66680 x1870607944957568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951180.384737:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951180.384740:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783951180.384742:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951180.384746:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1783951180.384760:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783951180.384764:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0380fb7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951180.384776:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03489c5180 x1870607944957696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951180.384808:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944957568:0@lo:8:kworker.0 00000400:00000100:0.0:1783951180.384857:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944957568 offset 0 length 520: 4 00000100:00100000:0.0:1783951180.384891:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944957696:0@lo:8:kworker.0 00000400:00000100:0.0:1783951180.384906:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944957696 offset 0 length 520: 4 00000100:00100000:1.0:1783951180.385110:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944957184:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385182:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951180.385207:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783951180.385213:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944957056:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951180.385261:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944957824:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385288:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951180.385316:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944957440:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951180.385356:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951180.385361:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944957312:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951180.385415:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944957056 00000100:00100000:1.0:1783951180.385422:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944957056 00000100:00100000:1.0:1783951180.385463:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951180.385471:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+16:3655:x1870607944957056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385512:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+16:3655:x1870607944957056:12345-0@lo:400:kworker.0 Request processed in 42us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.385526:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951180.385557:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944957824 00000100:00100000:1.0:1783951180.385560:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944957824 00000100:00100000:1.0:1783951180.385579:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944957312 00000100:00100000:1.0:1783951180.385582:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944957312 00000100:00100000:1.0:1783951180.385606:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951180.385612:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944957824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385650:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944957824:12345-0@lo:400:kworker.0 Request processed in 39us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.385656:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951180.385667:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951180.385672:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944957312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385697:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944957312:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.385702:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951180.385716:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944957184 00000100:00100000:1.0:1783951180.385719:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944957184 00000100:00100000:1.0:1783951180.385737:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944957440 00000100:00100000:1.0:1783951180.385739:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944957440 00000100:00100000:1.0:1783951180.385762:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951180.385768:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944957184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385795:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944957184:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.385801:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951180.385810:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951180.385815:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944957440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385844:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944957440:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.385850:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783951180.385885:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0247b66a00 x1870607944957312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951180.385898:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944957312:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385906:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944957440:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385924:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944957056:0@lo:400:kworker.0 00010000:00080000:1.0:1783951180.385932:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e03489c6300 x1870607944957824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951180.385940:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944957824:0@lo:400:kworker.0 00000100:00100000:1.0:1783951180.385947:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944957184:0@lo:400:kworker.0 10000000:01000000:1.0:1783951180.640204:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951180.640213:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e024667e000 from 13 10000000:01000000:1.0:1783951180.640220:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951180.640276:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951180.640288:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951180.640300:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951180.640326:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944957952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951180.642863:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951180.642983:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951180.650876:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944957952 00000100:00100000:2.0:1783951180.650892:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944957952 00000100:00100000:2.0:1783951180.650971:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951180.650983:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+16:17197:x1870607944957952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951180.651003:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951180.651024:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9317 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.651053:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.651065:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.651076:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608400, rc 0) 00000100:00100000:2.0:1783951180.651181:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944957952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951180.651189:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951180.651249:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944957952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951180.651278:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.651289:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951180.653039:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.653122:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951180.653178:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951180.653198:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958080 00000100:00100000:2.0:1783951180.653204:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958080 00000100:00100000:2.0:1783951180.653245:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951180.653253:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944958080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.653394:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944958080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951180.653403:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951180.653449:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.653490:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.653530:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951180.653558:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951180.653566:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958208 00000100:00100000:1.0:1783951180.653570:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958208 00000100:00100000:1.0:1783951180.653601:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783951180.653608:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944958208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951180.653698:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944958208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.653705:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783951180.653783:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951180.654730:0:18447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783951180.654945:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783951180.654969:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951180.654979:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.654991:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951180.655014:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783951180.655017:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0248309800 from 13 10000000:01000000:2.0:1783951180.655020:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951180.655050:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.655058:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.655067:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951180.655085:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.655131:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951180.655231:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951180.655616:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958336 00000100:00100000:3.0:1783951180.655624:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958336 00000100:00100000:3.0:1783951180.656416:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951180.656432:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+17:17197:x1870607944958336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951180.656448:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951180.656465:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9325 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951180.656493:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951180.656504:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951180.656525:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145e00, rc 0) 00000100:00100000:3.0:1783951180.656598:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944958336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951180.656605:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951180.656702:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951180.656719:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951180.656729:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951180.656814:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.656844:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951180.661825:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951180.662120:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958464 00000100:00100000:1.0:1783951180.662131:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958464 00000100:00100000:1.0:1783951180.662211:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783951180.662221:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944958464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951180.662546:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944958464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (5699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951180.662555:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951180.663609:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.663669:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951180.663735:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951180.663782:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951180.663838:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958592 00000100:00100000:3.0:1783951180.663844:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958592 00000100:00100000:3.0:1783951180.663890:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783951180.663898:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944958592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951180.663993:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:17197:x1870607944958592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951180.664000:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951180.664220:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944958592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951180.665128:0:18450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783951180.667493:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783951180.667523:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951180.667537:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951180.667550:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951181.088892:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951181.408361:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944958848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951181.408441:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951181.408480:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944958720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951181.408502:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951181.408504:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958848 00000100:00100000:1.0:1783951181.408512:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958848 00000100:00100000:0.0:1783951181.408533:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958720 00000100:00100000:0.0:1783951181.408536:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958720 00000100:00100000:1.0:1783951181.408561:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951181.408570:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944958848:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951181.408606:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951166/real 1783951166] req@ffff9e024860d180 x1870607944949632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000024:1.0:1783951181.408621:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783951181.408632:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e024860d180 x1870607944949632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951181.408644:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951166/real 1783951166] req@ffff9e024860f100 x1870607944949760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951181.408670:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e024860f100 x1870607944949760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951181.408678:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944958848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00080000:3.0:1783951181.408688:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783951181.408688:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783951181.408709:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783951181.408710:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783951181.408717:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949632:0@lo:8:kworker.0 00000100:00100000:1.0:1783951181.408723:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944958720:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1783951181.408726:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951181.408734:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783951181.408745:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944949760:0@lo:8:kworker.0 00000004:00000024:1.0:1783951181.408753:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951181.408785:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944958720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951181.408799:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1783951181.408815:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951181.408820:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783951181.408822:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951181.408827:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1783951181.408831:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951181.408836:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0350e6f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951181.408856:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860d180 x1870607944959104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951181.408870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951181.408874:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783951181.408875:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951181.408879:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1783951181.408882:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951181.408885:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0342df7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951181.408894:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860fb80 x1870607944959232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951181.409065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951181.409069:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951181.409073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951181.409076:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951181.409111:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944958976:0@lo:400:kworker.0 00000100:00100000:3.0:1783951181.409174:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951181.409194:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944958848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951181.409209:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951181.409213:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944958720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951181.409218:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944959360:0@lo:400:kworker.0 00000100:00100000:0.0:1783951181.409230:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951181.409239:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944959488:0@lo:400:kworker.0 00000100:00100000:3.0:1783951181.409247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951181.409275:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944958976 00000100:00100000:0.0:1783951181.409280:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951181.409281:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944958976 00000100:00100000:3.0:1783951181.409316:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783951181.409318:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944959360 00000100:00100000:3.0:1783951181.409324:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3652:x1870607944958976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951181.409324:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944959360 00000100:00100000:3.0:1783951181.409362:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+18:3652:x1870607944958976:12345-0@lo:400:kworker.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951181.409369:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783951181.409369:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944959488 00000100:00100000:0.0:1783951181.409374:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944959488 00000100:00100000:0.0:1783951181.409397:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951181.409406:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944959360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951181.409416:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944958976:0@lo:400:kworker.0 00000100:00100000:3.0:1783951181.409438:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944959104:0@lo:8:kworker.0 00000100:00100000:0.0:1783951181.409449:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944959360:12345-0@lo:400:kworker.0 Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951181.409457:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000400:00000100:3.0:1783951181.409462:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944959104 offset 0 length 520: 4 00000100:00100000:0.0:1783951181.409473:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951181.409479:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944959232:0@lo:8:kworker.0 00000100:00100000:0.0:1783951181.409484:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944959488:12345-0@lo:400:kworker.0 00000400:00000100:3.0:1783951181.409506:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607944959232 offset 0 length 520: 4 00000100:00100000:0.0:1783951181.409532:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944959488:12345-0@lo:400:kworker.0 Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951181.409548:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783951181.409582:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e024860d880 x1870607944959360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951181.409591:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944959360:0@lo:400:kworker.0 00010000:00080000:0.0:1783951181.409610:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e024860ca80 x1870607944959488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951181.409617:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944959488:0@lo:400:kworker.0 00010000:00010000:1.0:1783951182.116267:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951182.178484:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1783951182.438197:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783951183.137811:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951184.160407:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951185.186071:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783951185.230685:0:18702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783951185.230689:0:18702:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783951185.230691:0:18702:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783951185.230808:0:18702:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0343db7000 00000020:01000004:3.0:1783951185.231934:0:18702:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783951185.232021:0:18702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783951185.232102:0:18702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e037795b380) 00000020:00000080:2.0:1783951185.232126:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783951185.297978:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783951185.300285:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783951185.301751:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783951185.302005:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783951185.305757:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783951185.306603:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783951185.307288:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1783951185.317438:0:18702:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783951185.317631:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783951185.317643:0:18702:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783951185.317652:0:18702:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7645c8e1169f933a 00000020:01000004:0.0:1783951185.317659:0:18702:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783951185.317679:0:18702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783951185.317683:0:18702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783951185.317691:0:18702:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783951185.317696:0:18702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783951185.317716:0:18702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e0351ba99c0) 00000020:00000080:0.0:1783951185.317728:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1783951185.323182:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951185.323310:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783951185.323315:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783951185.327775:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783951185.327787:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783951185.330970:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783951185.330985:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783951185.336297:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951185.336501:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783951185.336507:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783951185.337011:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783951185.337015:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783951185.351978:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951185.359959:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951185.359978:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783951185.369275:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951185.369289:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783951185.375388:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951185.375409:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783951185.403619:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951185.403823:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783951185.403829:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783951185.407832:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783951185.407846:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783951185.478714:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951185.479092:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783951185.479100:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783951185.487582:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783951185.487596:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783951185.488021:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783951185.488053:0:18702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783951185.488060:0:18702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783951185.522916:0:18702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783951185.522971:0:18702:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783951185.522980:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783951185.522981:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951185.522983:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951185.522984:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951185.522985:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951185.522987:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951185.522988:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951185.522990:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951185.522991:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951185.522995:0:18702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783951185.522997:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951185.522999:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951185.522999:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951185.523000:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951185.523002:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951185.523003:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951185.523004:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951185.523005:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951185.523006:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951185.523034:0:18702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783951185.523055:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944959616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951185.523126:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.523388:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951185.526516:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944959616 00000100:00100000:2.0:1783951185.526532:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944959616 00000100:00100000:2.0:1783951185.527363:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783951185.527375:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:18702:x1870607944959616:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951185.527491:0:17193:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783951185.527496:0:17193:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1783951185.527499:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783951185.528198:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:18702:x1870607944959616:12345-0@lo:253:mount.lustre.0 Request processed in 822us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.528288:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783951185.531659:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944959616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951185.531681:0:18702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783951185.531684:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951185.531686:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951185.531687:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951185.531688:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951185.531689:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951185.531691:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951185.531692:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951185.531694:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951185.531695:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783951185.538524:0:18702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0343db7000 from lustre-OST0000 10000000:01000000:1.0:1783951185.538662:0:18702:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783951185.538666:0:18702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783951185.538676:0:18702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e0247714d40 local copy 00010000:00010000:1.0:1783951185.538688:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951185.538833:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944959744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951185.538912:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.540646:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0359c27180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.545454:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944959744 00000100:00100000:3.0:1783951185.545469:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944959744 00000100:00100000:3.0:1783951185.545711:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783951185.545726:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:18702:x1870607944959744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951185.545882:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+18:18702:x1870607944959744:12345-0@lo:501:mount.lustre.0 Request processed in 160us (6969us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951185.545986:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944959744:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783951185.546015:0:18702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783951185.546044:0:18702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783951185.546054:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.546065:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951185.546100:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0343db7000 10000000:01000000:1.0:1783951185.546105:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783951185.546110:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783951185.546113:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951185.546124:0:18702:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783951185.546126:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951185.546186:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.546196:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.546218:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951185.546239:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944959872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951185.546276:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.546307:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0359c27180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951185.547821:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944959872 00000100:00100000:2.0:1783951185.547834:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944959872 00000100:00100000:3.0:1783951185.553874:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951185.557730:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783951185.557753:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+18:18702:x1870607944959872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951185.557773:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951185.557794:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f934f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9348 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.557824:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f934f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9348 expref: 19 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.557835:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f934f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9348 expref: 19 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.557843:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608e00, rc 0) 00000100:00100000:2.0:1783951185.557924:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944959872:12345-0@lo:101:mount.lustre.0 Request processed in 182us (11647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.557930:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783951185.558035:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944959872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951185.558056:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.558065:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951185.562124:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783951185.564771:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951185.570960:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783951185.571029:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783951185.571048:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783951185.571063:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783951185.571099:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783951185.571115:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783951185.571187:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783951185.571202:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783951185.571331:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951185.571403:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.571595:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.571754:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960000 00000100:00100000:3.0:1783951185.571762:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960000 00000100:00100000:3.0:1783951185.571809:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783951185.571819:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951185.571988:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960000:12345-0@lo:501:mount.lustre.0 Request processed in 170us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.571996:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951185.572137:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951185.572372:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951185.572408:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.572502:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951185.572620:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960128 00000100:00100000:2.0:1783951185.572625:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960128 00000100:00100000:2.0:1783951185.572656:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783951185.572663:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951185.573405:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960128:12345-0@lo:503:mount.lustre.0 Request processed in 739us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951185.573538:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783951185.574052:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783951185.574135:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951185.574308:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783951185.577388:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.578560:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960256 00000100:00100000:0.0:1783951185.578571:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960256 00000100:00100000:0.0:1783951185.578642:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951185.578668:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951185.579386:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951185.581347:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960256:12345-0@lo:502:mount.lustre.0 Request processed in 2675us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.581360:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783951185.581910:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951185.582243:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783951185.582276:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783951185.582291:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783951185.582305:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783951185.582318:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783951185.582333:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783951185.582346:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783951185.582362:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783951185.582375:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783951185.582389:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783951185.582403:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783951185.582452:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1783951185.582493:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951185.583751:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.583822:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951185.584191:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960384 00000100:00100000:2.0:1783951185.584199:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960384 00000100:00100000:2.0:1783951185.584269:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783951185.584278:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951185.584461:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960384:12345-0@lo:502:mount.lustre.0 Request processed in 183us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.584469:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951185.585500:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951185.585605:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783951185.585618:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1783951185.592304:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951185.592317:0:18719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783951185.592324:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951185.592326:0:18719:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783951185.592332:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951185.592350:0:18719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e036c2e4d40) 00000020:00000080:3.0:1783951185.592377:0:18719:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783951185.592383:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783951185.592469:0:18719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0343db7000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783951185.592479:0:18719:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783951185.592485:0:18719:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7645c8e1169f935d 00010000:00010000:0.0:1783951185.610836:0:18719:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1783951185.612394:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1783951185.616091:0:18719:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783951185.623465:0:18719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783951185.623479:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951185.623486:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951185.623488:0:18719:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783951185.623491:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951185.623494:0:18719:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783951185.623496:0:18719:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951185.623498:0:18719:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951185.623500:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951185.623502:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951185.623504:0:18719:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951185.623506:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951185.623509:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951185.623510:0:18719:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951185.623513:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951185.623515:0:18719:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783951185.623517:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951185.623520:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951185.623521:0:18719:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783951185.623524:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951185.623526:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951185.623527:0:18719:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783951185.623531:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783951185.623649:0:18719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951185.623654:0:18719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951185.623655:0:18719:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783951185.623660:0:18719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783951185.632804:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783951185.632853:0:18702:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783951185.632889:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.632902:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951185.632911:0:18702:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db7000 from 1 10000000:01000000:0.0:1783951185.632913:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951185.632958:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.632966:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.632976:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951185.633001:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951185.633069:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.634420:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.644821:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960512 00000100:00100000:3.0:1783951185.644837:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960512 00000100:00100000:3.0:1783951185.644914:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951185.644924:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+19:18702:x1870607944960512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951185.644942:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951185.644962:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9364 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.644999:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.645030:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.645040:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030000, rc 0) 00000100:00100000:3.0:1783951185.645119:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960512:12345-0@lo:101:mount.lustre.0 Request processed in 196us (12050us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.645129:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951185.645402:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951185.645440:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.645450:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951185.649118:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783951185.650668:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951185.653329:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783951185.653367:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783951185.653390:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783951185.653396:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783951185.653520:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951185.654693:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.654864:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.662798:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960640 00000100:00100000:3.0:1783951185.662813:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960640 00000100:00100000:3.0:1783951185.662891:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783951185.662902:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951185.664874:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960640:12345-0@lo:501:mount.lustre.0 Request processed in 1965us (10176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.664890:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951185.672871:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951185.672945:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951185.673031:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.673125:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.677481:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960768 00000100:00100000:3.0:1783951185.677496:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960768 00000100:00100000:0.0:1783951185.680566:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951185.680582:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951185.680780:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960768:12345-0@lo:503:mount.lustre.0 Request processed in 202us (7748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.680788:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783951185.680887:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960768:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783951185.681377:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783951185.681479:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951185.681532:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.689494:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d84840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951185.691518:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944960896 00000100:00100000:2.0:1783951185.691532:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944960896 00000100:00100000:2.0:1783951185.691857:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783951185.691882:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951185.692168:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944960896:12345-0@lo:502:mount.lustre.0 Request processed in 288us (10635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.692177:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951185.697712:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944960896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783951185.698914:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783951185.698957:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783951185.698975:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783951185.698992:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783951185.699005:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783951185.699022:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783951185.699039:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783951185.699056:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1783951185.699072:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783951185.699089:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1783951185.699104:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1783951185.699187:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951185.700637:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951185.700749:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951185.704492:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961024 00000100:00100000:0.0:1783951185.704509:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961024 00000100:00100000:2.0:1783951185.707642:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783951185.707657:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944961024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951185.707866:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944961024:12345-0@lo:502:mount.lustre.0 Request processed in 213us (7233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.707873:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951185.707960:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951185.708054:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1783951185.708076:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783951185.712496:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951185.712509:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951185.712511:0:18723:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783951185.712519:0:18723:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0343db7000 00000020:00000080:1.0:1783951185.712522:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951185.712533:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951185.712535:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951185.712536:0:18723:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783951185.712539:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951185.712541:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951185.712664:0:18723:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783951185.712672:0:18723:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0343db7000 00000020:00000080:1.0:1783951185.712673:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951185.712744:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951185.716321:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951185.716329:0:18723:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783951185.716341:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951185.716348:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951185.716350:0:18723:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783951185.716355:0:18723:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0343db7000 00000020:00000080:3.0:1783951185.716358:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951185.716569:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951185.716574:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951185.716575:0:18723:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783951185.716578:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951185.716580:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951185.716594:0:18723:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783951185.716599:0:18723:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0343db7000 00000020:00000080:3.0:1783951185.716601:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951185.716653:0:18723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951185.716657:0:18723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951185.716659:0:18723:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783951185.716662:0:18723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1783951185.716976:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783951185.717010:0:18702:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951185.717027:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.717040:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951185.717102:0:18702:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951185.717106:0:18702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0343db7000 10000000:01000000:0.0:1783951185.717109:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0343db7000 10000000:01000000:0.0:1783951185.717114:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951185.717127:0:18702:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0343db7000 from 1 10000000:01000000:0.0:1783951185.717129:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951185.717194:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.717492:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.717505:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951185.717532:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951185.717670:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.717717:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951185.718222:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961152 00000100:00100000:2.0:1783951185.718229:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961152 00000100:00100000:2.0:1783951185.718282:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783951185.718292:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:18702:x1870607944961152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951185.718307:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951185.718329:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608800/0x7645c8e1169f9379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9372 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.718353:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608800/0x7645c8e1169f9379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9372 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.718365:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608800/0x7645c8e1169f9379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9372 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.718374:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608800, rc 0) 00000100:00100000:2.0:1783951185.718427:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961152:12345-0@lo:101:mount.lustre.0 Request processed in 136us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.718435:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783951185.718897:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951185.718915:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.718924:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951185.725105:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783951185.725455:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951185.726014:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783951185.726050:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783951185.726066:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783951185.726084:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783951185.726099:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783951185.726114:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783951185.726130:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783951185.726174:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783951185.726193:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783951185.726499:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783951185.726522:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783951185.726540:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783951185.726641:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783951185.726658:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783951185.726677:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783951185.726720:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783951185.726748:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783951185.726764:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783951185.726781:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783951185.726798:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783951185.726815:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783951185.726832:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783951185.726847:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783951185.726863:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783951185.726880:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783951185.726898:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783951185.726916:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783951185.726935:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783951185.726952:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783951185.726969:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783951185.726984:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783951185.727015:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783951185.727034:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783951185.727052:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783951185.727068:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783951185.727085:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783951185.727100:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783951185.727131:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783951185.727137:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783951185.730851:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951185.730920:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.730964:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0345c056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.730994:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961280 00000100:00100000:3.0:1783951185.731000:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961280 00000100:00100000:3.0:1783951185.731048:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783951185.731057:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951185.732614:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961280:12345-0@lo:501:mount.lustre.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.732641:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783951185.732736:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951185.732791:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951185.732854:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.732896:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.732913:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961408 00000100:00100000:3.0:1783951185.732918:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961408 00000100:00100000:3.0:1783951185.732955:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951185.732962:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951185.733073:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961408:12345-0@lo:503:mount.lustre.0 Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.733080:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951185.733127:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951185.739878:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951185.739993:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951185.740099:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.740186:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951185.741672:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961536 00000100:00100000:0.0:1783951185.741685:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961536 00000100:00100000:0.0:1783951185.741760:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783951185.741771:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951185.741936:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961536:12345-0@lo:502:mount.lustre.0 Request processed in 166us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.741945:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783951185.742077:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951185.742939:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783951185.742985:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783951185.743003:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783951185.743020:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783951185.743037:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783951185.743052:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783951185.743067:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783951185.743094:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783951185.743128:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783951185.744815:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783951185.744858:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783951185.744875:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783951185.744890:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783951185.744904:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783951185.744919:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783951185.744932:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783951185.744946:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783951185.744963:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783951185.744979:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783951185.744994:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783951185.745010:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783951185.745027:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783951185.745045:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783951185.745065:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783951185.745083:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1783951185.745114:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1783951185.745131:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1783951185.748796:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1783951185.748857:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1783951185.748873:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1783951185.748888:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1783951185.748903:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1783951185.748918:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1783951185.748933:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1783951185.748950:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1783951185.748967:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1783951185.748982:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1783951185.748996:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1783951185.749013:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1783951185.749028:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1783951185.749059:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1783951185.749097:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1783951185.749116:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1783951185.749131:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1783951185.749178:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1783951185.749197:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1783951185.751769:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1783951185.751805:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1783951185.751872:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951185.751956:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.752002:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.752032:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961664 00000100:00100000:3.0:1783951185.752038:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961664 00000100:00100000:3.0:1783951185.755035:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783951185.755059:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951185.755273:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961664:12345-0@lo:502:mount.lustre.0 Request processed in 223us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.755281:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783951185.762623:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951185.762868:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783951185.762901:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1783951185.762938:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951185.763008:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.763046:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951185.763078:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961792 00000100:00100000:3.0:1783951185.763084:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961792 00000100:00100000:3.0:1783951185.763136:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783951185.763170:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951185.763300:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944961792:12345-0@lo:502:mount.lustre.0 Request processed in 132us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.763308:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783951185.763355:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944961792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951185.763392:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1783951185.763401:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783951185.775529:0:18728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783951185.775559:0:18728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e036c2e0000) 00000020:00000080:3.0:1783951185.775588:0:18728:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783951185.776108:0:18728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0343db7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783951185.776114:0:18728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0343db7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783951185.776117:0:18728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db7000 3 00010000:00080000:3.0:1783951185.776172:0:18728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246bcb800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951185.785706:0:18728:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783951185.785813:0:18728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783951185.785861:0:18728:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783951185.785874:0:18728:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7645c8e1169f9387 00000100:00080000:3.0:1783951185.785884:0:18728:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951185.785890:0:18728:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e0246bcb800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951185.785926:0:18728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860f100 x1870607944961920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951185.785958:0:18728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783951185.786021:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951185.786026:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951185.786030:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951185.786033:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951185.786068:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951185.786071:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951185.786075:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951185.786077:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951185.786110:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944962432:0@lo:400:kworker.0 00000100:00100000:3.0:1783951185.786198:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951185.787283:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944962048:0@lo:400:kworker.0 00000100:00100000:0.0:1783951185.787531:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944961920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951185.789084:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944962176:0@lo:400:kworker.0 00000100:00100000:2.0:1783951185.789232:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.791183:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944962304:0@lo:400:kworker.0 00000100:00100000:3.0:1783951185.791245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.791297:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962432 00000100:00100000:3.0:1783951185.791304:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962432 00000100:00100000:3.0:1783951185.791353:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951185.791363:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944962432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951185.791425:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607944962432:12345-0@lo:400:kworker.0 Request processed in 64us (5227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951185.791432:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783951185.792094:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e024860ea00 x1870607944962432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951185.792110:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607944962432:0@lo:400:kworker.0 00000100:00100000:2.0:1783951185.792159:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962048 00000100:00100000:2.0:1783951185.792167:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962048 00000100:00100000:2.0:1783951185.792199:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962304 00000100:00100000:2.0:1783951185.792203:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962304 00000100:00100000:2.0:1783951185.792220:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951185.792227:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944962048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951185.792338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.792420:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951185.792428:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944962304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951185.792978:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944962304:12345-0@lo:400:kworker.0 Request processed in 548us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.792986:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951185.793025:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944961920 00000100:00100000:0.0:1783951185.793030:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944961920 00000100:00100000:0.0:1783951185.793052:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951185.793057:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607944961920:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783951185.793079:0:17199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1783951185.793115:0:17199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7645c8e1169f938e 00000004:00100000:0.0:1783951185.793130:0:17199:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951185.793190:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9e0246684800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951185.793232:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1870607944961920:12345-0@lo:38:llog_process_th.0 Request processed in 174us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.793238:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783951185.793270:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e024860f100 x1870607944961920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951185.793280:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951185.793288:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783951185.793295:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783951185.793299:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951185.793302:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951185.793307:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607944961920:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951185.793420:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944962304:0@lo:400:kworker.0 00000100:00100000:1.0:1783951185.794071:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.794119:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962176 00000100:00100000:0.0:1783951185.794125:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962176 00000100:00100000:0.0:1783951185.794316:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951185.794324:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944962176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951185.794369:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944962176:12345-0@lo:400:kworker.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.794935:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783951185.794985:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e024860d880 x1870607944962176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951185.794999:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944962176:0@lo:400:kworker.0 00000100:00100000:2.0:1783951185.797903:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944962048:12345-0@lo:400:kworker.0 Request processed in 5667us (8662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951185.797920:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951185.798038:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944962048:0@lo:400:kworker.0 00000020:01000004:2.0:1783951185.798325:0:18728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783951185.798342:0:18728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e037795cd40) 00000020:00000080:2.0:1783951185.798367:0:18728:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1783951185.798554:0:18728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0343db7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951185.798559:0:18728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0343db7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951185.798569:0:18728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db7000 3 00010000:00080000:2.0:1783951185.798609:0:18728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246b90000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783951185.802300:0:18728:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1783951185.802420:0:18728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783951185.802469:0:18728:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951185.802481:0:18728:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7645c8e1169f939c 00000100:00080000:2.0:1783951185.802492:0:18728:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951185.802497:0:18728:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e0246b90000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951185.802534:0:18728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248337b80 x1870607944962560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951185.802563:0:18728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783951185.802633:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951185.802639:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951185.802642:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951185.802645:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951185.802649:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951185.802652:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951185.802655:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951185.802658:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951185.802722:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607944962560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951185.802808:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951185.802881:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962560 00000100:00100000:0.0:1783951185.802888:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962560 00000100:00100000:0.0:1783951185.802929:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951185.802937:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944962560:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783951185.802964:0:17200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1783951185.802995:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7645c8e1169f93a3 00000004:00100000:0.0:1783951185.803011:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951185.803041:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9e0246680000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951185.803090:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1870607944962560:12345-0@lo:38:llog_process_th.0 Request processed in 151us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.803098:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783951185.803131:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0248337b80 x1870607944962560/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951185.803161:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951185.803169:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783951185.803176:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783951185.803181:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783951185.803184:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246b90000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951185.803190:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607944962560:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783951185.803438:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1783951185.803623:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783951185.803653:0:18702:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783951185.803717:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.803740:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951185.803793:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783951185.803796:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783951185.803812:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951185.803813:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951185.803815:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951185.803816:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951185.803818:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951185.803819:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951185.803821:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951185.803824:0:18702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1783951185.803827:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951185.803828:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783951185.803830:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951185.803831:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951185.803833:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951185.803834:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951185.803835:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951185.803837:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951185.803838:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951185.803855:0:18702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783951185.803868:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944962688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951185.803905:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951185.803936:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951185.804122:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962688 00000100:00100000:0.0:1783951185.804128:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962688 00000100:00100000:0.0:1783951185.804190:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783951185.804199:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944962688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951185.804226:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783951185.804241:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783951185.810446:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951185.810471:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783951185.810521:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951185.810527:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951185.810549:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.810569:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.810577:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.810585:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.810626:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.810642:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 21 pid: 17192 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951185.810670:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944962816:0@lo:104: 00000100:00100000:2.0:1783951185.810746:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.810795:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962816 00000100:00100000:1.0:1783951185.810803:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962816 00010000:00010000:2.0:1783951185.810815:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951185.810825:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 21 pid: 17194 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951185.810834:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944962944:0@lo:104: 00000100:00100000:1.0:1783951185.810861:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951185.810865:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951185.810876:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944962816:12345-0@lo:104: 00000100:00100000:2.0:1783951185.810878:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5780 going to sleep for 11 seconds 00010000:00010000:1.0:1783951185.810892:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.810951:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951185.810958:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944962816:12345-0@lo:104: Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951185.810965:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951185.810987:0:17182:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783951185.810995:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944962944 00000100:00100000:1.0:1783951185.810998:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944962944 00000100:00100000:1.0:1783951185.811015:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951185.811021:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03413ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944962944:12345-0@lo:104: 00000100:00100000:2.0:1783951185.811029:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944962816:0@lo:104: 00010000:00010000:1.0:1783951185.811030:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811119:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783951185.811126:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03413ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944962944:12345-0@lo:104: Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951185.811132:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783951185.811239:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951185.811246:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811254:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951185.811259:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951185.811269:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:18702:x1870607944962688:12345-0@lo:253:mount.lustre.0 Request processed in 7070us (7362us total) trans 0 rc 0/0 00010000:00010000:1.0:1783951185.811279:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951185.811279:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 10000000:00010000:1.0:1783951185.811287:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951185.811294:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:18702:1870607944962688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783951185.811294:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951185.811311:0:18702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783951185.811315:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951185.811317:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783951185.811319:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951185.811321:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951185.811322:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1783951185.811327:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951185.811331:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951185.811334:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951185.811338:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951185.811342:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1783951185.811342:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:02000000:3.0:1783951185.811359:0:18702:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783951185.811372:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811380:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382145c00/0x7645c8e1169f92fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9302 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811391:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951185.811394:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811400:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382144800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951185.811403:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811419:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951185.811427:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951185.811440:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951185.811455:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811461:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783951185.811473:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944963072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951185.811476:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811483:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0382144800/0x7645c8e1169f92ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f92f4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951185.811494:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951185.811496:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951185.811497:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951185.811500:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951185.811503:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951185.811520:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944963200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951185.811535:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963072 00000100:00100000:0.0:1783951185.811538:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963072 00000100:00100000:1.0:1783951185.811545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951185.811982:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944962944:0@lo:104: 00010000:00010000:2.0:1783951185.812004:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812574:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 21 pid: 17192 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951185.812602:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963200 00000100:00100000:0.0:1783951185.812607:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963200 00010000:00010000:0.0:1783951185.812620:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 22 pid: 17194 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951185.812640:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951185.812651:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:3655:x1870607944963072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951185.812662:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951185.812668:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 22 pid: 17192 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.812680:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 22 pid: 17192 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.812695:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f9302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f92fb expref: 22 pid: 17192 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.812721:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951185.812770:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3655:x1870607944963072:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.812854:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951185.812863:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e90c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3652:x1870607944963200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951185.812872:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951185.812876:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 21 pid: 17194 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812897:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 21 pid: 17194 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951185.812908:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783951185.812909:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608600/0x7645c8e1169f92f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f92ed expref: 21 pid: 17194 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812925:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812933:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783951185.812947:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005457501s 00000100:00100000:3.0:1783951185.812950:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944963072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951185.812952:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812962:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812969:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812976:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812982:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951185.812986:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.812993:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.813019:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951185.813030:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951185.813037:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.813047:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951185.813055:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f93aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951185.813071:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e90c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3652:x1870607944963200:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951185.813080:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951185.813346:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944963200:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1783951185.814747:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783951185.818274:0:18702:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783951185.818283:0:18702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783951185.818319:0:18702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783951185.818387:0:18702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783951185.818409:0:18702:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783951185.818442:0:18702:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783951185.820577:0:18702:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951185.821912:0:18702:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951186.208810:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951186.528719:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944963328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951186.528799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951186.528912:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963328 00000100:00100000:0.0:1783951186.528920:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963328 00000100:00100000:0.0:1783951186.528972:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951186.528983:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944963328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951186.529024:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951186.529133:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944963456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951186.529200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951186.529240:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963456 00000100:00100000:1.0:1783951186.529244:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963456 00000100:00100000:1.0:1783951186.529265:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951186.529272:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944963456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951186.529293:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951186.529329:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944963456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951186.529345:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951186.529391:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944963456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951186.542950:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944963328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13959us (14141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951186.542966:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951186.543740:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944963328:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1783951186.797400:0:18782:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951186.797918:0:18782:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951187.232343:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783951187.553179:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951187.553186:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e024667e000 from 9 10000000:01000000:1.0:1783951187.553190:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951187.553234:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951187.553246:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951187.553257:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951187.553284:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951187.553349:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951187.553454:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951187.559746:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963584 00000100:00100000:2.0:1783951187.559761:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963584 00000100:00100000:2.0:1783951187.560644:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783951187.560658:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:17197:x1870607944963584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951187.560676:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951187.560717:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f93b1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951187.560749:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951187.560760:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951187.560769:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608600, rc 0) 00000100:00100000:2.0:1783951187.560849:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:17197:x1870607944963584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (7499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951187.560857:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783951187.562754:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951187.562783:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.562797:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951187.562873:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951187.562934:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951187.562983:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951187.563039:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963712 00000100:00100000:0.0:1783951187.563046:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963712 00000100:00100000:0.0:1783951187.563097:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783951187.563107:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+20:17197:x1870607944963712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951187.563127:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783951187.563164:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951187.563167:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1783951187.563257:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+20:17197:x1870607944963712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951187.563265:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951187.563350:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783951187.563423:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951187.563431:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563440:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951187.563450:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783951187.563458:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0248309800 from 9 10000000:01000000:3.0:1783951187.563460:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951187.563483:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563491:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563499:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951187.563512:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951187.563758:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951187.563784:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951187.563797:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963840 00000100:00100000:3.0:1783951187.563801:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963840 00000100:00100000:3.0:1783951187.563821:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783951187.563826:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:17197:x1870607944963840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951187.563835:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951187.563846:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f93bf expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563866:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563874:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563882:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0340030e00, rc 0) 00000100:00100000:3.0:1783951187.563909:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944963840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951187.563923:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783951187.563954:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951187.563965:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.563972:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951187.564010:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951187.564039:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951187.564051:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951187.564063:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944963968 00000100:00100000:3.0:1783951187.564065:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944963968 00000100:00100000:3.0:1783951187.564083:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783951187.564088:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944963968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951187.564097:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951187.564108:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951187.564111:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1783951187.564218:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944963968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951187.564225:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783951187.564252:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944963968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783951187.564294:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951187.564299:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951187.564317:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951188.259668:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951188.641966:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951189.281954:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951190.307634:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951191.143480:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951191.143489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951191.143492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951191.143549:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951191.143568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951191.143572:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951191.143575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951191.143579:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951191.143646:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944964096:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.143753:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.143803:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944964608:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.143833:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.143870:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951191.143874:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944964480:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.143895:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.143918:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944964352:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.143933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.143943:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944964864:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.143960:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.143970:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783951191.143973:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944964224:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.143985:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.143995:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944964736:0@lo:400:kworker.0 00000100:00100000:2.0:1783951191.144009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951191.144025:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964096 00000100:00100000:1.0:1783951191.144307:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964480 00000100:00100000:2.0:1783951191.144411:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964096 00000100:00100000:2.0:1783951191.144469:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783951191.144479:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3655:x1870607944964096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951191.144608:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964480 00000100:00100000:0.0:1783951191.144730:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964608 00000100:00100000:0.0:1783951191.144735:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964608 00000100:00100000:0.0:1783951191.144768:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964352 00000100:00100000:0.0:1783951191.144771:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964352 00000100:00100000:0.0:1783951191.144782:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964864 00000100:00100000:0.0:1783951191.144784:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964864 00000100:00100000:0.0:1783951191.144806:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964736 00000100:00100000:0.0:1783951191.144809:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964736 00000100:00100000:0.0:1783951191.144822:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951191.144829:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944964608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951191.144905:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944964608:12345-0@lo:400:kworker.0 Request processed in 76us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951191.144913:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951191.144931:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951191.144937:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944964352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951191.144969:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944964352:12345-0@lo:400:kworker.0 Request processed in 33us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951191.144975:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951191.144986:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951191.144992:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944964864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951191.145018:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944964864:12345-0@lo:400:kworker.0 Request processed in 26us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951191.145024:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951191.145049:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783951191.145055:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944964736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951191.145081:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944964736:12345-0@lo:400:kworker.0 Request processed in 26us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951191.145086:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1783951191.145120:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951191.145129:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783951191.145181:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0248334380 x1870607944964608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951191.145198:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944964608:0@lo:400:kworker.0 00010000:00080000:0.0:1783951191.145233:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0248336a00 x1870607944964736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951191.145241:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944964736:0@lo:400:kworker.0 00010000:00080000:0.0:1783951191.145252:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0248337100 x1870607944964352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951191.145260:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944964352:0@lo:400:kworker.0 00010000:00080000:0.0:1783951191.145270:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0248335880 x1870607944964864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951191.145278:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944964864:0@lo:400:kworker.0 00000100:00100000:1.0:1783951191.145415:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964224 00000100:00100000:1.0:1783951191.145420:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964224 00000100:00100000:2.0:1783951191.145527:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3655:x1870607944964096:12345-0@lo:400:kworker.0 Request processed in 1047us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951191.145535:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783951191.145791:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944964096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951191.145881:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951191.145897:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944964480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951191.145941:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944964480:12345-0@lo:400:kworker.0 Request processed in 52us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951191.145948:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951191.145967:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951191.145973:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944964224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951191.146004:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944964224:12345-0@lo:400:kworker.0 Request processed in 32us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951191.146009:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951191.146045:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944964224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951191.146200:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944964480:0@lo:400:kworker.0 00010000:00010000:1.0:1783951191.328390:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951191.650654:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944964992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951191.651541:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951191.651608:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944964992 00000100:00100000:1.0:1783951191.651619:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944964992 00000100:00100000:1.0:1783951191.651695:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951191.651762:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944964992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951191.651804:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951191.651852:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944964992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951191.651860:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951191.651918:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944964992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951191.652362:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951191.652369:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944965120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951191.652482:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951191.652510:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965120 00000100:00100000:1.0:1783951191.652514:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965120 00000100:00100000:1.0:1783951191.652533:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951191.652538:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944965120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951191.652558:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951191.652583:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944965120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951191.652588:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951191.652612:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944965120:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1783951192.322717:0:19071:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783951192.356727:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951192.416826:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1783951193.284934:0:19123:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951193.285546:0:19123:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951193.376346:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783951194.227872:0:19174:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951194.228415:0:19174:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951194.408699:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951195.040289:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951180/real 1783951180] req@ffff9e0247b66680 x1870607944957568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.040338:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e0247b66680 x1870607944957568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.040364:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951180/real 1783951180] req@ffff9e03489c5180 x1870607944957696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.040378:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03489c5180 x1870607944957696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951195.040430:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951195.040462:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951195.040468:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944957568:0@lo:8:kworker.0 00000100:00080000:0.0:1783951195.040475:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951195.040481:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951195.040484:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944957696:0@lo:8:kworker.0 00000100:00080000:3.0:1783951195.040886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951195.040893:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951195.040896:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951195.040907:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951195.040954:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951195.040972:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944965504:0@lo:400:kworker.0 00000100:00100000:3.0:1783951195.041059:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951195.041210:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944965248:0@lo:400:kworker.0 00000100:00100000:1.0:1783951195.041254:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951195.041297:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951195.041302:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944965376:0@lo:400:kworker.0 00000100:00100000:1.0:1783951195.041332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951195.041378:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965376 00000100:00100000:1.0:1783951195.041387:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965376 00000100:00100000:2.0:1783951195.041413:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965248 00000100:00100000:2.0:1783951195.041420:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965248 00000100:00100000:1.0:1783951195.041453:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951195.041468:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783951195.041469:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944965376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951195.041480:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3652:x1870607944965248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951195.041633:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3652:x1870607944965248:12345-0@lo:400:kworker.0 Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951195.041654:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1783951195.041669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951195.041674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783951195.041678:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951195.041695:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1783951195.041701:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951195.041707:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e037e6de000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951195.041722:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944965248:0@lo:400:kworker.0 00000100:00100000:3.0:1783951195.041723:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944965632:0@lo:400:kworker.0 00000100:00100000:1.0:1783951195.041895:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944965376:12345-0@lo:400:kworker.0 Request processed in 431us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951195.041903:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951195.042031:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951195.042095:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc66d80 x1870607944965760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951195.042106:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944965376:0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.042247:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965504 00000100:00100000:0.0:1783951195.042254:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965504 00000100:00100000:0.0:1783951195.042297:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783951195.042306:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944965504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.042358:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944965504:12345-0@lo:400:kworker.0 Request processed in 53us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951195.042365:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783951195.042401:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc66300 x1870607944965504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.042412:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944965504:0@lo:400:kworker.0 00000100:00080000:3.0:1783951195.042651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951195.042656:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783951195.042658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951195.042663:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1783951195.042667:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951195.042672:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0380fb7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951195.042831:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965632 00000100:00100000:1.0:1783951195.042836:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965632 00000100:00100000:1.0:1783951195.042874:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783951195.042881:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944965632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951195.042925:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944965632:12345-0@lo:400:kworker.0 Request processed in 44us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951195.042932:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951195.043012:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944965632:0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.043037:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944965760:0@lo:8:kworker.0 00000100:00100000:0.0:1783951195.043075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951195.043305:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc66a00 x1870607944965888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951195.043382:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944966272:0@lo:400:kworker.0 00000100:00100000:2.0:1783951195.043412:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944966016:0@lo:400:kworker.0 00000100:00100000:3.0:1783951195.043423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951195.043457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951195.043624:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965760 00000100:00100000:1.0:1783951195.043630:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965760 00000100:00100000:1.0:1783951195.043660:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951195.043667:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607944965760:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783951195.043833:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944965888:0@lo:8:kworker.0 00000100:00100000:0.0:1783951195.043867:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783951195.043878:0:18707:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1783951195.043920:0:18707:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f93cd 00000100:00100000:0.0:1783951195.043932:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966272 00000100:00100000:0.0:1783951195.043936:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966272 00002000:00100000:1.0:1783951195.043937:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e0247acd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783951195.043943:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1783951195.043946:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783951195.043977:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966016 00000100:00100000:0.0:1783951195.043980:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966016 00000100:00100000:0.0:1783951195.043992:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951195.043998:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944966272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.044038:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944966272:12345-0@lo:400:kworker.0 Request processed in 40us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951195.044044:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951195.044058:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951195.044063:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944966016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.044094:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944966016:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951195.044101:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783951195.044116:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951195.044132:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944966144:0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.044177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951195.044203:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966144 00000100:00100000:0.0:1783951195.044206:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966144 00010000:00080000:3.0:1783951195.044216:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64700 x1870607944966272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.044228:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783951195.044229:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944966272:0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.044234:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944966144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951195.044264:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944966144:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951195.044271:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783951195.044280:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64e00 x1870607944966144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951195.044284:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951195.044290:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944966144:0@lo:400:kworker.0 00010000:00080000:0.0:1783951195.044311:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc65500 x1870607944966016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.044321:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944966016:0@lo:400:kworker.0 00000100:00100000:2.0:1783951195.044424:0:18709:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783951195.044434:0:18709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:1.0:1783951195.045010:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1783951195.045044:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e0247ac8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951195.045659:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607944965760:12345-0@lo:8:kworker.0 Request processed in 1988us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951195.045806:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951195.045835:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944965888 00000100:00100000:1.0:1783951195.045842:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944965888 00000100:00100000:1.0:1783951195.045885:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951195.045892:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607944965888:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783951195.045915:0:18707:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1783951195.046684:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc66d80 x1870607944965760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.046699:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951195.046713:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783951195.046845:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783951195.046854:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783951195.046858:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783951195.047408:0:17942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783951195.047441:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870607944966528:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1783951195.047892:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951195.047938:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342f43b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951195.047981:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783951195.048003:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966528 00000100:00100000:3.0:1783951195.048012:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966528 00000100:00100000:3.0:1783951195.048089:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951195.048115:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944966400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951195.048199:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783951195.048659:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783951195.048682:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944965760:0@lo:8:kworker.0 00000100:00080000:0.0:1783951195.048768:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783951195.050228:0:17941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783951195.050387:0:17941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 550698243993ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783951195.050398:0:17941:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783951195.050779:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966400 00000100:00100000:0.0:1783951195.050793:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966400 00000100:00100000:0.0:1783951195.050851:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951195.051023:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1870607944966400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951195.051061:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00010000:00080000:2.0:1783951195.051256:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64e00 x1870607944966400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951195.051289:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944966400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951195.051436:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1870607944966400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 573us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951195.051446:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951195.052007:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951195.052022:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870607944966528:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1783951195.055976:0:17932:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1783951195.061256:0:19194:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783951195.061271:0:19194:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783951195.061447:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870607944966528:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9423us (13550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951195.061461:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951195.063758:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607944965888:12345-0@lo:8:kworker.0 Request processed in 17855us (19880us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951195.063774:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783951195.064850:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951195.064878:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951195.064883:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944965888:0@lo:8:kworker.0 00010000:00080000:3.0:1783951195.067844:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64700 x1870607944966528/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783951211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951195.067868:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870607944966528:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1783951195.067888:0:17942:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1783951195.067945:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870607944966656:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1783951195.068023:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951195.069916:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342f43b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951195.072037:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966656 00000100:00100000:2.0:1783951195.072056:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966656 00000100:00100000:2.0:1783951195.072164:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951195.072178:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17942:x1870607944966656:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783951195.072226:0:18708:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1783951195.072355:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17942:x1870607944966656:12345-0@lo:5:osp-pre-0-1.0 Request processed in 177us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951195.072364:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783951195.072774:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64700 x1870607944966656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951195.072798:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870607944966656:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783951195.072815:0:17942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783951195.072863:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870607944966784:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783951195.072923:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951195.072972:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951195.074220:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966784 00000100:00100000:2.0:1783951195.074234:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966784 00000100:00100000:2.0:1783951195.074301:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951195.074316:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870607944966784:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783951195.074374:0:19194:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1783951195.120075:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1783951195.120090:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783951195.120368:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17942:x1870607944966784:12345-0@lo:5:osp-pre-0-1.0 Request processed in 46052us (47439us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783951195.120379:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783951195.120483:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02479c5880 x1870607944966784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951211 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951195.120495:0:17942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783951195.120501:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870607944966784:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1783951195.120516:0:17942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1783951195.120574:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1870607944966912:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783951195.120809:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951195.120845:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0344c0db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951195.120913:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944966912 00000100:00100000:2.0:1783951195.120932:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944966912 00000100:00100000:2.0:1783951195.121038:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951195.121048:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1870607944966912:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783951195.121107:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1870607944966912:12345-0@lo:900:osp-pre-0-1.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951195.121113:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783951195.121245:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e03489c6d80 x1870607944966912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783951211 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951195.121254:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1870607944966912:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1783951195.434484:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951196.455775:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951196.768313:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944967040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951196.768398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951196.768457:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967040 00000100:00100000:1.0:1783951196.768465:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967040 00000100:00100000:1.0:1783951196.768509:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951196.768518:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944967040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951196.768555:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951196.768611:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944967040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951196.768618:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951196.768663:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944967040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951196.768866:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944967168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951196.768895:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951196.768967:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967168 00000100:00100000:3.0:1783951196.768971:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967168 00000100:00100000:3.0:1783951196.769006:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951196.769014:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944967168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951196.769033:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783951196.769082:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944967168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951196.769089:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951196.769213:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944967168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951197.472583:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951198.496361:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951198.882287:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951199.520417:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951200.353460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951200.353469:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951200.353472:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951200.353475:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951200.353507:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951200.353510:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951200.353514:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951200.353524:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:1.0:1783951200.353542:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783951200.353550:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0380fb7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951200.353586:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247b66d80 x1870607944967936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951200.353741:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944967424:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.353832:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.353892:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944968064:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.353915:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.353941:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783951200.353946:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944967296:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.353971:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.353994:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944967808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.354015:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.354040:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944967552:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.354060:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.354075:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944968192:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.354097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.354112:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951200.354116:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944967680:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.354132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.354176:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944968320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.354198:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.354226:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944967936:0@lo:8:kworker.0 00000100:00100000:1.0:1783951200.354476:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.354547:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967424 00000100:00100000:1.0:1783951200.354556:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967424 00000100:00100000:1.0:1783951200.354613:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967680 00000100:00100000:1.0:1783951200.354616:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967680 00000100:00100000:1.0:1783951200.354777:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951200.354788:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944967424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951200.354915:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967808 00000100:00100000:3.0:1783951200.354920:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967808 00000100:00100000:3.0:1783951200.354965:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967936 00000100:00100000:3.0:1783951200.354969:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967936 00000100:00100000:3.0:1783951200.354986:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951200.354993:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944967808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.355050:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944967424:12345-0@lo:400:kworker.0 Request processed in 262us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951200.355057:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951200.355076:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951200.355083:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944967680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.355120:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944967680:12345-0@lo:400:kworker.0 Request processed in 38us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951200.355126:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951200.355183:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968064 00000100:00100000:1.0:1783951200.355188:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968064 00000100:00100000:1.0:1783951200.355209:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967552 00000100:00100000:1.0:1783951200.355212:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967552 00000100:00100000:1.0:1783951200.355223:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968192 00000100:00100000:1.0:1783951200.355226:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968192 00000100:00100000:1.0:1783951200.355239:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968320 00000100:00100000:1.0:1783951200.355254:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968320 00000100:00100000:1.0:1783951200.355271:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951200.355277:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944968064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783951200.355396:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951200.355402:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951200.355404:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951200.356097:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944967808:12345-0@lo:400:kworker.0 Request processed in 1101us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951200.356109:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951200.356134:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951200.356160:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3651:x1870607944967936:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783951200.356185:0:18709:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951200.359947:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951200.359978:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783951200.360010:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951200.360035:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951200.360056:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944967552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951200.360201:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944967552:12345-0@lo:400:kworker.0 Request processed in 152us (6138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951200.360210:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951200.360252:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951200.360260:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951200.360268:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944968192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951200.360322:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944968192:12345-0@lo:400:kworker.0 Request processed in 55us (6223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951200.360329:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951200.360340:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951200.360347:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951200.360353:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944968320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951200.360383:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944968320:12345-0@lo:400:kworker.0 Request processed in 30us (6183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951200.360388:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951200.360415:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944967296 00000100:00100000:0.0:1783951200.360425:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944967296 00000100:00100000:0.0:1783951200.360477:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783951200.360484:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3655:x1870607944967296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951200.360521:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3655:x1870607944967296:12345-0@lo:400:kworker.0 Request processed in 37us (6548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951200.360528:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783951200.361174:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944968064:12345-0@lo:400:kworker.0 Request processed in 5891us (7252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951200.361184:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951200.361268:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944967680:0@lo:400:kworker.0 00010000:00080000:1.0:1783951200.361305:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0247b66a00 x1870607944968320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951200.361316:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944968320:0@lo:400:kworker.0 00010000:00080000:1.0:1783951200.361329:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02479c7480 x1870607944967552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951200.361338:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944967552:0@lo:400:kworker.0 00010000:00080000:1.0:1783951200.361348:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0247b65180 x1870607944968192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951200.361355:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944968192:0@lo:400:kworker.0 00000100:00100000:1.0:1783951200.361464:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944968448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951200.361529:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951200.361596:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968448 00000100:00100000:1.0:1783951200.361601:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968448 00000100:00100000:1.0:1783951200.361762:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951200.361770:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944968448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951200.361802:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951200.361841:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944968448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951200.361847:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783951200.361875:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0247a2bb80 x1870607944968448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951200.361890:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944968448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951200.361993:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944967424:0@lo:400:kworker.0 00010000:00080000:2.0:1783951200.362030:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0247b66300 x1870607944968064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951200.362041:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944968064:0@lo:400:kworker.0 00000100:00100000:2.0:1783951200.362061:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944967296:0@lo:400:kworker.0 00010000:00080000:2.0:1783951200.362072:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0247b66680 x1870607944967808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951200.362079:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944967808:0@lo:400:kworker.0 00000100:00100000:3.0:1783951200.369191:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3651:x1870607944967936:12345-0@lo:8:kworker.0 Request processed in 12990us (14656us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951200.369212:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783951200.369794:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951200.369815:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951200.369820:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944967936:0@lo:8:kworker.0 00010000:00010000:1.0:1783951200.544763:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951201.376959:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951181/real 1783951181] req@ffff9e024860d180 x1870607944959104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951201 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951201.377006:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e024860d180 x1870607944959104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951201 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951201.377015:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951181/real 1783951181] req@ffff9e024860fb80 x1870607944959232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951201 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951201.377027:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e024860fb80 x1870607944959232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951201 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951201.377046:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951201.377069:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783951201.377074:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944959104:0@lo:8:kworker.0 00000100:00080000:1.0:1783951201.377079:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951201.377084:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783951201.377086:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944959232:0@lo:8:kworker.0 00000100:00080000:3.0:1783951201.383211:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951201.383218:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783951201.383232:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951201.383240:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1783951201.383246:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783951201.383252:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0350e6f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951201.383279:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc64700 x1870607944968832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951201.383297:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951201.383301:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783951201.383302:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951201.383306:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1783951201.383308:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783951201.383311:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0342df7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951201.383323:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc66a00 x1870607944968960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951201.383368:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951201.383371:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783951201.383373:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951201.383378:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1783951201.383380:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951201.383384:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0380fb7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951201.383395:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc64000 x1870607944969472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951201.383460:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944969216:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.383530:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.383585:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944969856:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.383613:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.383646:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783951201.383653:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944968576:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.383682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.383708:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944969344:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.383735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.383764:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944968704:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.383789:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.383927:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968576 00000100:00100000:2.0:1783951201.383936:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968576 00000100:00100000:2.0:1783951201.383985:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783951201.383996:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3654:x1870607944968576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951201.384118:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969856 00000100:00100000:0.0:1783951201.384123:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969856 00000100:00100000:0.0:1783951201.384172:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951201.384180:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944969856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951201.385362:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969344 00000100:00100000:1.0:1783951201.385372:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969344 00000100:00100000:1.0:1783951201.385432:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951201.385450:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944969344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.385668:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3654:x1870607944968576:12345-0@lo:400:kworker.0 Request processed in 1673us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.385679:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783951201.385760:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944968576:0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.387541:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944969088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.387639:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.387677:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944969728:0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.387699:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.387738:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969088 00000100:00100000:2.0:1783951201.387745:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969088 00000100:00100000:2.0:1783951201.387780:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969728 00000100:00100000:2.0:1783951201.387783:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969728 00000100:00100000:2.0:1783951201.387805:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951201.387813:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944969088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.387868:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944969088:12345-0@lo:400:kworker.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.387875:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951201.387895:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951201.387901:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.387928:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944969728:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.387933:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1783951201.387967:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64e00 x1870607944969088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951201.387980:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944969088:0@lo:400:kworker.0 00010000:00080000:2.0:1783951201.387990:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc65c00 x1870607944969728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951201.387998:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944969728:0@lo:400:kworker.0 00000100:00100000:2.0:1783951201.388021:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944968832:0@lo:8:kworker.0 00000100:00100000:2.0:1783951201.388075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.388120:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944968960:0@lo:8:kworker.0 00000100:00100000:2.0:1783951201.388170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.388189:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944969472:0@lo:8:kworker.0 00000100:00100000:2.0:1783951201.388213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.388250:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968832 00000100:00100000:2.0:1783951201.388254:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968832 00000100:00100000:2.0:1783951201.388267:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968960 00000100:00100000:2.0:1783951201.388269:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968960 00000100:00100000:2.0:1783951201.388275:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969472 00000100:00100000:2.0:1783951201.388277:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969472 00000100:00100000:2.0:1783951201.388285:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951201.388289:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607944968832:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783951201.388316:0:19194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1783951201.388350:0:19194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f93d4 00002000:00100000:2.0:1783951201.388364:0:19194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e0246b93000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783951201.388369:0:19194:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783951201.388371:0:19194:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783951201.388451:0:19194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951201.388476:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e0246b95800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951201.388518:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607944968832:12345-0@lo:8:kworker.0 Request processed in 227us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.388525:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951201.388539:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951201.388543:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607944968960:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783951201.388566:0:19194:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951201.388600:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607944968960:12345-0@lo:8:kworker.0 Request processed in 55us (429us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951201.388607:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951201.388619:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951201.388623:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607944969472:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783951201.388633:0:19194:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951201.388657:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607944969472:12345-0@lo:8:kworker.0 Request processed in 33us (443us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951201.388662:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783951201.388693:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc64700 x1870607944968832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951201.388701:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951201.388711:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783951201.388719:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783951201.388725:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783951201.388727:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783951201.388742:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783951201.388746:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944968832:0@lo:8:kworker.0 00000100:00080000:2.0:1783951201.388758:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951201.388762:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951201.388765:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944968960:0@lo:8:kworker.0 00000100:00080000:2.0:1783951201.388774:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951201.388777:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951201.388780:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944969472:0@lo:8:kworker.0 00000004:00080000:2.0:1783951201.388829:0:17224:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1783951201.388856:0:17224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1870607944970112:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951201.388881:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.388897:0:17224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0347c2fb40 going to sleep for 11 seconds 00000004:00080000:2.0:1783951201.388912:0:17223:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783951201.388988:0:17223:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 557036845898ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783951201.388996:0:17223:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783951201.389197:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944969984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951201.389228:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.389263:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969984 00000100:00100000:2.0:1783951201.389267:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969984 00000100:00100000:2.0:1783951201.389309:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951201.389316:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944969984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951201.389331:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951201.389371:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944969984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.389377:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783951201.389408:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0248334380 x1870607944969984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951201.389423:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944969984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951201.389450:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970112 00000100:00100000:2.0:1783951201.389453:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970112 00000100:00100000:2.0:1783951201.389475:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951201.389481:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17224:x1870607944970112:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783951201.392073:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944969600:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.392170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.392229:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969216 00000100:00100000:3.0:1783951201.392236:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969216 00000100:00100000:3.0:1783951201.392286:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944968704 00000100:00100000:3.0:1783951201.392289:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944968704 00000100:00100000:3.0:1783951201.392306:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951201.392313:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944969216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.392375:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944969216:12345-0@lo:400:kworker.0 Request processed in 61us (8844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.392383:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951201.392399:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951201.392407:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944968704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.392459:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944968704:12345-0@lo:400:kworker.0 Request processed in 52us (8668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.392464:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951201.392482:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944969600 00000100:00100000:3.0:1783951201.392493:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944969600 00000100:00100000:3.0:1783951201.392521:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951201.392528:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944969600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.392572:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944969600:12345-0@lo:400:kworker.0 Request processed in 44us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.392577:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951201.392619:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944969216:0@lo:400:kworker.0 00000100:00100000:3.0:1783951201.392650:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944968704:0@lo:400:kworker.0 00010000:00080000:3.0:1783951201.392662:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc66300 x1870607944969600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951201.392672:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944969600:0@lo:400:kworker.0 00000004:00080000:2.0:1783951201.395097:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783951201.395638:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944969856:12345-0@lo:400:kworker.0 Request processed in 11451us (12014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.395653:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783951201.395707:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783951201.395752:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc67b80 x1870607944969856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951201.395786:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944969856:0@lo:400:kworker.0 00000100:00100000:1.0:1783951201.398105:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944969344:12345-0@lo:400:kworker.0 Request processed in 12646us (14358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.398123:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783951201.399597:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc65500 x1870607944969344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951201.399617:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944969344:0@lo:400:kworker.0 00002000:00080000:2.0:1783951201.400992:0:19194:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1783951201.401011:0:19194:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1783951201.401033:0:19194:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1783951201.410258:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.410275:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.410603:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.410608:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.410617:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.410640:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.410653:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.410662:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.410695:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.410894:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.410907:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.410921:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.410926:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.410936:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.410983:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.410991:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7812710/0x7645c8e1169f93db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.411020:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.411022:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.411024:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.411234:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.411242:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.411254:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.411258:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.411263:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.411282:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.411718:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.411727:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.411753:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.412406:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.412419:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.412432:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.412448:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.412459:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.412478:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.412486:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4e6ee1/0x7645c8e1169f93e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.412525:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.412527:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.412529:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.412753:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.412764:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.412777:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.412782:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.412788:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.412801:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.412810:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.412833:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.412857:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.413017:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.413025:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.413035:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.413038:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.413046:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.413059:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.413066:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c4713b/0x7645c8e1169f93e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.413082:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.413084:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.413086:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.414510:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.414534:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.414553:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.414566:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.414572:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.414586:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.414597:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.414605:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.414629:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.414814:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.414826:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.414853:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.414858:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.414868:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.414887:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.414894:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f93f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.414918:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.414919:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.414921:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.416721:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.416737:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.416765:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.416769:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.416777:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.416792:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.416801:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.416810:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.416835:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.417610:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.417629:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.417643:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.417649:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.417660:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.417698:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.417707:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000104e6b29/0x7645c8e1169f93f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951201.417736:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951201.417738:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.417742:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.417747:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.417751:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.417767:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.417771:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.417776:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.417788:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.417809:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.417817:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.417840:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.419771:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.419786:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951201.419794:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951201.419811:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951201.419816:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.419820:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.419865:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.419866:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.419883:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.419897:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.419909:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.419916:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.419921:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006500d0c6/0x7645c8e1169f93fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.419943:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.419962:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.419993:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.420001:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.420006:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.420014:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.420017:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.420025:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.420027:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783951201.420043:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.420050:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9405 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.420063:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.420066:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.420069:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.422197:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.422215:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.422234:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.422239:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.422245:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.422261:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.422274:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.422283:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.422329:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.423741:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.423756:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.423771:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.423776:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.423785:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.423826:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.423906:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.423936:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f940c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.423964:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.423966:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.423968:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951201.424922:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951201.424933:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.424948:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=557s v=(0 0) 00010000:00010000:0.0:1783951201.424953:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951201.424961:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.424976:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.424987:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.424994:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.425115:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.426093:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.426104:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.426129:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.426134:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.426169:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.426191:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.426199:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbca6172/0x7645c8e1169f9413 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.426220:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.426222:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.426224:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951201.427120:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951201.427133:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.427219:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=557s v=(0 0) 00010000:00010000:0.0:1783951201.427225:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951201.427242:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.427256:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.427265:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.427273:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.427339:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.430281:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.430296:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.430309:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ca00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.430314:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.430337:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.430358:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.430365:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c0b6ae/0x7645c8e1169f941a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.433600:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.433612:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.433619:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.433789:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.433805:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.433851:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.433858:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.433868:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.433893:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.433906:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.433917:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.433955:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.434232:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.434249:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.434264:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.434270:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.434281:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.434304:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.434313:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9421 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.434360:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.434363:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.434365:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.437982:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.438003:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438027:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.438033:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.438042:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438059:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438090:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438099:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438139:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.438192:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.438207:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.438221:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.438227:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.438239:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.438272:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.438281:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f9428 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.438305:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.438307:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.438309:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.438883:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.438893:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438906:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.438911:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.438916:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438928:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438936:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438944:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.438978:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.439018:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.439027:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.439038:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.439042:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.439053:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.439069:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.439077:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae921c9c/0x7645c8e1169f942f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.439110:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.439112:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.439114:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.439585:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.439594:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.439605:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.439608:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.439613:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.439624:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.439633:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.439641:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.439661:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.440195:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.440203:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.440213:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.440217:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.440226:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.440242:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.440249:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9436 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.440283:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.440285:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.440287:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.440914:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.440926:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.440939:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.440954:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.440960:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.440973:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.440982:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.440989:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.441011:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.441244:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.441252:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.441277:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.441281:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.441290:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.441304:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.441311:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d476a1e/0x7645c8e1169f943d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.441330:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.441332:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.441334:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.442651:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.442667:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.442685:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.442690:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.442697:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.442713:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.442725:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.442744:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.442775:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.443662:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.443677:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.443692:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.443697:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.443708:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.443738:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.443746:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f022867b/0x7645c8e1169f9444 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.443769:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.443772:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.443774:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.447113:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.447549:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.447584:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.447590:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.447599:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.447618:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.447632:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.447640:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.447680:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.448577:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.448594:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.448609:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.448615:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.448626:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.448651:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.448658:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b5a8590/0x7645c8e1169f944b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.448693:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.448695:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.448697:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.449765:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.449783:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.449815:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.449821:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.449828:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.449844:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.449856:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.449865:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.449898:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951201.449934:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951201.449946:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.449983:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951201.449989:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.450000:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.450019:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.450028:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4842499/0x7645c8e1169f9452 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.450052:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.450055:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951201.450059:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.456441:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.456462:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.456487:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.456494:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.456502:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.456520:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.456650:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.456658:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.456685:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.457113:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.457129:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.457172:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.457178:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.457190:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.457212:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.457220:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000572dac98/0x7645c8e1169f9459 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.457265:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.457267:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.457269:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.458164:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.458180:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.458198:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.458204:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.458212:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.458228:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.458239:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.458248:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.458312:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951201.459949:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.459968:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.459989:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.459995:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.460002:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.460018:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.460032:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.460041:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.460064:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951201.460706:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951201.460722:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460738:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.460743:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460755:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460780:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460788:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eaa2533/0x7645c8e1169f9460 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460820:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.460824:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460831:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.460854:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460862:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460871:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460878:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000898d4782/0x7645c8e1169f9467 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.460893:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.460895:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.460897:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.460907:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.463183:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.463203:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.463226:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.463243:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.463251:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.463270:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.463283:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.463291:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.463348:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.463361:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.463377:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.463393:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.463399:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.463411:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.463436:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.463452:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f946e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.463482:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.463485:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.463487:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951201.470473:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951201.470487:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.470505:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=557s v=(0 0) 00010000:00010000:0.0:1783951201.470509:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951201.470515:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.470529:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.470539:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.470584:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.470609:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951201.471190:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.471210:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.471228:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.471233:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.471245:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.471261:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.471278:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.471324:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.471358:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951201.471682:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951201.471692:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471703:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.471707:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471717:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471735:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471742:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003705c156/0x7645c8e1169f9475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471760:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.471764:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471779:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.471782:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471789:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471799:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471805:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009520f2df/0x7645c8e1169f947c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.471820:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.471821:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.471823:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.471830:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.472119:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.472137:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.472177:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.472182:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.472188:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.472207:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.472217:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.472232:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.472262:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.472285:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.472293:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.472302:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.472306:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.472314:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.472335:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.472342:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c661cca/0x7645c8e1169f9483 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.472360:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.472361:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.472363:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.474833:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.474855:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.474890:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.474895:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.474911:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.474929:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.474946:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.474955:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.474986:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.475959:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.475974:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.475989:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.475995:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.476006:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.476028:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.476034:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24a57de/0x7645c8e1169f948a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.476071:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.476072:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.476074:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951201.476890:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951201.476905:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.476923:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1783951201.476929:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951201.476935:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.476950:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.476978:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.476986:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.477017:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951201.477052:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951201.477062:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.477075:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951201.477080:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.477089:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.477107:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.477115:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4d5f18/0x7645c8e1169f9491 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.477135:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.477137:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951201.477139:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951201.478895:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951201.478908:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.478938:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=557s v=(0 0) 00010000:00010000:1.0:1783951201.478942:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951201.478949:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.478963:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.478974:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.478981:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.479011:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783951201.479098:0:19194:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:2.0:1783951201.479225:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783951201.479227:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17224:x1870607944970112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89741us (90340us total) trans 0 rc 0/0 00010000:00010000:2.0:1783951201.479242:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951201.479244:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1783951201.479260:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951201.479267:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.479280:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.479623:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.479633:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9498 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.479658:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.479674:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.479677:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951201.479740:0:17224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1870607944970112:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951201.479760:0:17224:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1783951201.479833:0:17224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1870607944970240:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951201.479901:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.479947:0:17224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.479978:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970240 00000100:00100000:0.0:1783951201.479988:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970240 00000100:00100000:0.0:1783951201.480046:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951201.480056:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17224:x1870607944970240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783951201.480104:0:18709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1783951201.494074:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1783951201.494169:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783951201.494423:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17224:x1870607944970240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14362us (14516us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783951201.494446:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951201.494646:0:17224:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783951201.494656:0:17224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1870607944970240:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951201.494673:0:17224:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1783951201.571491:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783951201.592040:0:19521:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783951201.592045:0:19521:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783951201.592046:0:19521:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783951201.592238:0:19521:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0246bc8800 00000020:01000004:3.0:1783951201.592256:0:19521:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783951201.592276:0:19521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783951201.592303:0:19521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e0247754d40) 00000020:00000080:3.0:1783951201.592326:0:19521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783951201.679568:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783951201.683116:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783951201.683867:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783951201.684097:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783951201.684407:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783951201.685634:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783951201.685952:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1783951201.687716:0:19521:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783951201.687977:0:19521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783951201.687995:0:19521:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783951201.688009:0:19521:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7645c8e1169f94a6 00000020:01000004:1.0:1783951201.688016:0:19521:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783951201.688040:0:19521:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783951201.688044:0:19521:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783951201.688050:0:19521:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783951201.688085:0:19521:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783951201.688090:0:19521:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783951201.703992:0:19521:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783951201.704040:0:19521:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1783951201.704045:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783951201.704047:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951201.704048:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951201.704049:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951201.704051:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951201.704052:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951201.704054:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951201.704056:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951201.704058:0:19521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951201.704062:0:19521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1783951201.704064:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951201.704066:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951201.704067:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951201.704067:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951201.704068:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951201.704069:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951201.704070:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951201.704071:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951201.704072:0:19521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951201.704103:0:19521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783951201.704125:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970368:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951201.704392:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951201.704464:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951201.704601:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970368 00000100:00100000:2.0:1783951201.704610:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970368 00000100:00100000:2.0:1783951201.704675:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783951201.704685:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:19521:x1870607944970368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951201.704719:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783951201.704722:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1783951201.704726:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783951201.706897:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:19521:x1870607944970368:12345-0@lo:253:mount.lustre.0 Request processed in 2204us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.706911:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783951201.707101:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783951201.707128:0:19521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783951201.707131:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783951201.707133:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951201.707134:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951201.707135:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951201.707137:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951201.707138:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951201.707168:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951201.707171:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951201.707172:0:19521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783951201.707197:0:19521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0246bc8800 from lustre-OST0001 10000000:01000000:0.0:1783951201.707281:0:19521:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783951201.707285:0:19521:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783951201.707295:0:19521:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e0247714d40 local copy 00010000:00010000:0.0:1783951201.707309:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951201.707480:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951201.707522:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.707578:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371ca1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951201.709260:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970496 00000100:00100000:2.0:1783951201.709275:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970496 00000100:00100000:2.0:1783951201.709705:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783951201.709723:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:19521:x1870607944970496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951201.709892:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:19521:x1870607944970496:12345-0@lo:501:mount.lustre.0 Request processed in 170us (2369us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951201.709899:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783951201.710194:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970496:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783951201.710216:0:19521:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783951201.710250:0:19521:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783951201.710260:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.710271:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951201.710319:0:19521:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0246bc8800 10000000:01000000:1.0:1783951201.710324:0:19521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783951201.710330:0:19521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783951201.710333:0:19521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951201.710337:0:19521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783951201.710339:0:19521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783951201.710371:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.710387:0:19521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.710398:0:19521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951201.710420:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951201.710457:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951201.710485:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.710787:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970624 00000100:00100000:0.0:1783951201.710804:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970624 00000100:00100000:0.0:1783951201.710851:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783951201.710860:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:19521:x1870607944970624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951201.710871:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951201.710887:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5d600/0x7645c8e1169f94b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f94ad expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.710926:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5d600/0x7645c8e1169f94b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f94ad expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.710937:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5d600/0x7645c8e1169f94b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f94ad expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.710948:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d600, rc 0) 00000100:00100000:0.0:1783951201.710985:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944970624:12345-0@lo:101:mount.lustre.0 Request processed in 127us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.710991:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783951201.711470:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951201.711485:0:19521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.711495:0:19521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951201.713800:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783951201.714508:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951201.721225:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783951201.721297:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783951201.721319:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783951201.721334:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783951201.721349:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783951201.721365:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783951201.721413:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783951201.721420:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783951201.721546:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951201.721625:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.721682:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951201.722347:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970752 00000100:00100000:2.0:1783951201.722355:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970752 00000100:00100000:2.0:1783951201.722420:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783951201.722431:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944970752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951201.722615:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944970752:12345-0@lo:501:mount.lustre.0 Request processed in 185us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.722628:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783951201.725240:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951201.725314:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951201.725531:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.725586:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e7a480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951201.725649:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944970880 00000100:00100000:1.0:1783951201.725656:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944970880 00000100:00100000:1.0:1783951201.725721:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783951201.725731:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944970880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951201.726534:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944970880:12345-0@lo:503:mount.lustre.0 Request processed in 803us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.726542:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783951201.726815:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944970880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951201.729083:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951201.729774:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.729867:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.729927:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351f0af00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951201.730016:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971008 00000100:00100000:3.0:1783951201.730023:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971008 00000100:00100000:3.0:1783951201.730168:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783951201.730179:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944971008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951201.730656:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944971008:12345-0@lo:502:mount.lustre.0 Request processed in 479us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.730665:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783951201.731115:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951201.731390:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783951201.731451:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783951201.731471:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783951201.731487:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783951201.731503:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783951201.731518:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783951201.731534:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783951201.731548:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783951201.731576:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783951201.731611:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951201.731669:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951201.732671:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951201.732913:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971136 00000100:00100000:2.0:1783951201.732922:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971136 00000100:00100000:2.0:1783951201.732972:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783951201.732982:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944971136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951201.733128:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944971136:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951201.733137:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783951201.733409:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951201.733488:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1783951201.733503:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783951201.735373:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951201.735383:0:19525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783951201.735390:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951201.735393:0:19525:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783951201.735410:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951201.735427:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e0371854d40) 00000020:00000080:1.0:1783951201.735463:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783951201.735471:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783951201.735578:0:19525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0246bc8800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783951201.735587:0:19525:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951201.735595:0:19525:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7645c8e1169f94c2 00010000:00010000:1.0:1783951201.744499:0:19525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1783951201.746543:0:19525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1783951201.751585:0:19525:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1783951201.753959:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783951201.753974:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.753994:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.753996:0:19525:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783951201.754008:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951201.754013:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.754014:0:19525:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951201.754018:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951201.754020:0:19525:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783951201.754023:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.754025:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.754026:0:19525:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783951201.754028:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951201.754031:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.754032:0:19525:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783951201.754036:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783951201.754077:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.754081:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.754082:0:19525:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783951201.754085:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1783951201.754380:0:19521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783951201.754420:0:19521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783951201.754446:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.754459:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951201.754468:0:19521:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0246bc8800 from 1 10000000:01000000:2.0:1783951201.754479:0:19521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951201.754519:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.754528:0:19521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.754539:0:19521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951201.754577:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951201.754662:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.754707:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.754824:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971264 00000100:00100000:0.0:1783951201.754831:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971264 00000100:00100000:0.0:1783951201.754888:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783951201.754897:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+22:19521:x1870607944971264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951201.754912:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951201.754924:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f94c9 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.754961:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.754973:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.754982:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d800, rc 0) 00000100:00100000:0.0:1783951201.755409:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971264:12345-0@lo:101:mount.lustre.0 Request processed in 511us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.755417:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783951201.756622:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951201.756649:0:19521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.756662:0:19521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951201.759747:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783951201.760995:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951201.761756:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783951201.761789:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783951201.761828:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783951201.761834:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783951201.761927:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951201.762704:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.762786:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0344c0db40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.764906:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971392 00000100:00100000:0.0:1783951201.764921:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971392 00000100:00100000:0.0:1783951201.766633:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783951201.766659:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951201.766866:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971392:12345-0@lo:501:mount.lustre.0 Request processed in 219us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.766874:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783951201.767801:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951201.767869:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951201.767963:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.768068:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0344c0db40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.768588:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971520 00000100:00100000:0.0:1783951201.768596:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971520 00000100:00100000:0.0:1783951201.768653:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783951201.768662:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951201.768788:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971520:12345-0@lo:503:mount.lustre.0 Request processed in 127us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.768796:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783951201.769237:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951201.769793:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951201.769871:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951201.769923:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.770132:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.770239:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971648 00000100:00100000:0.0:1783951201.770245:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971648 00000100:00100000:0.0:1783951201.770296:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783951201.770303:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.770561:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971648:12345-0@lo:502:mount.lustre.0 Request processed in 247us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.770568:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783951201.770635:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951201.770829:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783951201.770856:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783951201.770871:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783951201.770885:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783951201.770898:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783951201.770911:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783951201.770923:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783951201.770936:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1783951201.770960:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783951201.770974:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1783951201.770987:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1783951201.771088:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951201.771126:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.771243:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951201.771276:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971776 00000100:00100000:1.0:1783951201.771281:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971776 00000100:00100000:1.0:1783951201.771347:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783951201.771354:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951201.771543:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971776:12345-0@lo:502:mount.lustre.0 Request processed in 189us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.771550:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783951201.771726:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951201.771771:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1783951201.771779:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783951201.772585:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951201.772595:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772597:0:19528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783951201.772604:0:19528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0246bc8800 00000020:00000080:0.0:1783951201.772606:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951201.772614:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.772616:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772617:0:19528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783951201.772619:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951201.772621:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772623:0:19528:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783951201.772626:0:19528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0246bc8800 00000020:00000080:0.0:1783951201.772628:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951201.772672:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.772675:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772676:0:19528:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783951201.772678:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951201.772680:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772681:0:19528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783951201.772684:0:19528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0246bc8800 00000020:00000080:0.0:1783951201.772686:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951201.772699:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.772701:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772702:0:19528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783951201.772704:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951201.772706:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772708:0:19528:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783951201.772721:0:19528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0246bc8800 00000020:00000080:0.0:1783951201.772724:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951201.772747:0:19528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951201.772751:0:19528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951201.772752:0:19528:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783951201.772755:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1783951201.772976:0:19521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783951201.773068:0:19521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951201.773121:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.773134:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951201.773221:0:19521:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783951201.773224:0:19521:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0246bc8800 10000000:01000000:3.0:1783951201.773228:0:19521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0246bc8800 10000000:01000000:3.0:1783951201.773232:0:19521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783951201.773238:0:19521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0246bc8800 from 1 10000000:01000000:3.0:1783951201.773240:0:19521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783951201.773279:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.773286:0:19521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.773296:0:19521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951201.773318:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951201.773384:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.773612:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951201.773705:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944971904 00000100:00100000:1.0:1783951201.773712:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944971904 00000100:00100000:1.0:1783951201.773757:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783951201.773765:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:19521:x1870607944971904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951201.773777:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951201.773792:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f94de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f94d7 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.773816:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f94de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f94d7 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.773828:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f94de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f94d7 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.773837:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66e00, rc 0) 00000100:00100000:1.0:1783951201.773877:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944971904:12345-0@lo:101:mount.lustre.0 Request processed in 113us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.773883:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783951201.773975:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944971904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951201.773990:0:19521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.774009:0:19521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951201.788491:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1783951201.789245:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951201.790240:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783951201.790283:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783951201.790301:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783951201.790318:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783951201.790334:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783951201.790347:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783951201.790362:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783951201.790375:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783951201.790388:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783951201.790415:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783951201.790431:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783951201.790445:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783951201.790459:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783951201.790473:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783951201.790487:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783951201.790502:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783951201.790516:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783951201.790530:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783951201.790545:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783951201.790573:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783951201.790588:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783951201.790618:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783951201.790635:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783951201.790650:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783951201.790663:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1783951201.790686:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1783951201.790699:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1783951201.790713:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1783951201.790728:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1783951201.790742:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1783951201.790756:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1783951201.790772:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1783951201.790789:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1783951201.792454:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1783951201.792484:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1783951201.792501:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1783951201.792518:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1783951201.792548:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1783951201.792581:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1783951201.792597:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1783951201.792613:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1783951201.792627:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1783951201.792642:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1783951201.792659:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1783951201.792675:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1783951201.792692:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1783951201.792726:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1783951201.792732:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1783951201.792857:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951201.792930:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.792986:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951201.795136:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972032 00000100:00100000:3.0:1783951201.795163:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972032 00000100:00100000:3.0:1783951201.795230:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783951201.795248:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951201.795434:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972032:12345-0@lo:501:mount.lustre.0 Request processed in 187us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.795441:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783951201.795504:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951201.795560:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951201.795612:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.795655:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0376830600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951201.795710:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972160 00000100:00100000:3.0:1783951201.795714:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972160 00000100:00100000:3.0:1783951201.795745:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783951201.795753:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951201.795848:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972160:12345-0@lo:503:mount.lustre.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.795854:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783951201.796017:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951201.796497:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951201.796586:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.796628:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.796656:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b3133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951201.796985:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972288 00000100:00100000:3.0:1783951201.796991:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972288 00000100:00100000:3.0:1783951201.797039:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783951201.797046:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951201.797177:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972288:12345-0@lo:502:mount.lustre.0 Request processed in 131us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.797184:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783951201.797719:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951201.797954:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783951201.797991:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783951201.798299:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783951201.798320:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783951201.798337:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783951201.798374:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783951201.798392:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783951201.798493:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783951201.798511:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783951201.798525:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783951201.798539:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783951201.798568:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783951201.798587:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783951201.798602:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783951201.798617:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783951201.798633:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783951201.798649:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783951201.798665:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783951201.798681:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783951201.798697:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783951201.798715:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783951201.798745:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783951201.798761:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783951201.798775:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783951201.799524:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783951201.799567:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783951201.799583:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783951201.799595:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783951201.799607:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783951201.799618:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783951201.799630:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783951201.799641:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783951201.799653:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783951201.799666:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783951201.799681:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783951201.799695:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783951201.799706:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783951201.799737:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783951201.799753:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783951201.799768:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783951201.799782:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783951201.799806:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783951201.799823:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783951201.799838:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783951201.799853:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783951201.799867:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783951201.799881:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783951201.799896:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783951201.799957:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.800058:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.800086:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.801382:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972416 00000100:00100000:0.0:1783951201.801394:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972416 00000100:00100000:0.0:1783951201.802590:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951201.802602:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.804485:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972416:12345-0@lo:502:mount.lustre.0 Request processed in 195us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.804499:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951201.804609:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951201.804901:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783951201.804929:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1783951201.804968:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.805523:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.805564:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951201.805588:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972544 00000100:00100000:0.0:1783951201.805593:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972544 00000100:00100000:0.0:1783951201.805626:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783951201.805633:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951201.805746:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972544:12345-0@lo:502:mount.lustre.0 Request processed in 112us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.805754:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783951201.805920:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951201.805973:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1783951201.805982:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783951201.820107:0:19533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783951201.820126:0:19533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e0351bacd40) 00000020:00000080:0.0:1783951201.820172:0:19533:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1783951201.828563:0:19533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0246bc8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783951201.828575:0:19533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0246bc8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783951201.828578:0:19533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0246bc8800 3 00010000:00080000:0.0:1783951201.828619:0:19533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e02481c1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783951201.830268:0:19533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1783951201.830393:0:19533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783951201.830464:0:19533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783951201.830479:0:19533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7645c8e1169f94ec 00000100:00080000:0.0:1783951201.830491:0:19533:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951201.830498:0:19533:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e02481c1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951201.830539:0:19533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03489c4a80 x1870607944972672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951201.830604:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944972672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951201.830678:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951201.830760:0:19533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783951201.831198:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972672 00000100:00100000:3.0:1783951201.831207:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972672 00000100:00100000:3.0:1783951201.831250:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951201.831259:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607944972672:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783951201.831285:0:17201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1783951201.831323:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7645c8e1169f94f3 00000004:00100000:3.0:1783951201.831339:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951201.831372:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9e02478ff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951201.831458:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1870607944972672:12345-0@lo:38:llog_process_th.0 Request processed in 198us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.831466:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783951201.835546:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e03489c4a80 x1870607944972672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951201.835572:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951201.835582:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783951201.835593:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783951201.835599:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951201.835602:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951201.835609:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607944972672:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1783951201.836294:0:19533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783951201.836311:0:19533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e0371850000) 00000020:00000080:1.0:1783951201.836339:0:19533:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783951201.836647:0:19533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0246bc8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783951201.836652:0:19533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0246bc8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783951201.836659:0:19533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0246bc8800 3 00010000:00080000:1.0:1783951201.836690:0:19533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0381195000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1783951201.843662:0:19533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1783951201.843781:0:19533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1783951201.843840:0:19533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783951201.843873:0:19533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7645c8e1169f9501 00000100:00080000:1.0:1783951201.843883:0:19533:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951201.843889:0:19533:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e0381195000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951201.843932:0:19533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0247a2bb80 x1870607944972800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951201.843972:0:19533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783951201.844802:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607944972800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951201.844884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951201.845609:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972800 00000100:00100000:1.0:1783951201.845619:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972800 00000100:00100000:1.0:1783951201.845677:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951201.845685:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607944972800:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783951201.845715:0:17200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:1.0:1783951201.845750:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7645c8e1169f9508 00000004:00100000:1.0:1783951201.845766:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783951201.845800:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9e0247629800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951201.845869:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1870607944972800:12345-0@lo:38:llog_process_th.0 Request processed in 182us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.845877:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783951201.845925:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0247a2bb80 x1870607944972800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951201.845937:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951201.847179:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1783951201.847201:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783951201.847229:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783951201.847233:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0381195000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783951201.847241:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607944972800:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783951201.847911:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1783951201.848700:0:19521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783951201.848751:0:19521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783951201.848777:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951201.848797:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951201.848865:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783951201.848868:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951201.848870:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951201.848871:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951201.848872:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951201.848878:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951201.848882:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951201.848884:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951201.848886:0:19521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951201.848890:0:19521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783951201.848895:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951201.848896:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951201.848898:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951201.848899:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951201.848901:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951201.848902:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951201.848903:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951201.848904:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951201.848909:0:19521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951201.848952:0:19521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783951201.848978:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951201.849138:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.849214:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348a6cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951201.849251:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944972928 00000100:00100000:3.0:1783951201.849258:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944972928 00000100:00100000:3.0:1783951201.849394:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783951201.849479:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951201.849514:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783951201.849538:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783951201.862394:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951201.862433:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783951201.862558:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951201.862563:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951201.862585:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.862620:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.862629:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.862636:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.862682:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.862698:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 24 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951201.862717:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944973056:0@lo:104: 00000100:00100000:2.0:1783951201.862793:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951201.862896:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.862906:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 24 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951201.862914:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944973184:0@lo:104: 00000100:00100000:2.0:1783951201.862939:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951201.863058:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:19521:x1870607944972928:12345-0@lo:253:mount.lustre.0 Request processed in 13580us (13918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951201.863070:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783951201.863716:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0a9ba1e-8c11-4522-a460-4e640633581c:19521:1870607944972928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951201.863732:0:19521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783951201.863737:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951201.863739:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951201.863740:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951201.863742:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951201.863743:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951201.863745:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951201.863747:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951201.863749:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951201.863751:0:19521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783951201.863766:0:19521:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783951201.867359:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03460bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951201.869117:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973056 00000100:00100000:1.0:1783951201.869130:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973056 00000100:00100000:1.0:1783951201.869205:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973184 00000100:00100000:1.0:1783951201.869211:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973184 00000100:00100000:1.0:1783951201.869230:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951201.869241:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+4:17215:x1870607944973056:12345-0@lo:104: 00010000:00010000:1.0:1783951201.869261:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.869358:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951201.869365:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+4:17215:x1870607944973056:12345-0@lo:104: Request processed in 127us (6572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.869373:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951201.869389:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951201.869395:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944973184:12345-0@lo:104: 00010000:00010000:1.0:1783951201.869403:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951201.869437:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783951201.869442:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+3:17215:x1870607944973184:12345-0@lo:104: Request processed in 48us (6503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.869448:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783951201.870207:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951201.870217:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870246:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951201.870251:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870261:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951201.870270:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951201.870276:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951201.870322:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870330:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951201.870349:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870357:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340030600/0x7645c8e1169f93bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f93c6 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870372:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951201.870376:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870381:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951201.870384:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870401:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951201.870408:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951201.870413:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951201.870426:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870431:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951201.870436:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870442:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67800/0x7645c8e1169f93b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f93b8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951201.870454:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.870456:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.870457:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951201.870463:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951201.870493:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944973056:0@lo:104: 00000100:00100000:2.0:1783951201.870503:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1870607944973184:0@lo:104: 00010000:00010000:2.0:1783951201.870532:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951201.870564:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944973440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951201.870609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951201.870652:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951201.870658:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944973312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951201.870676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951201.871916:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973440 00000100:00100000:0.0:1783951201.871926:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973440 00010000:00010000:0.0:1783951201.871963:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 24 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951201.871995:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973312 00000100:00100000:0.0:1783951201.872008:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973312 00010000:00010000:0.0:1783951201.872023:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 25 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951201.872043:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951201.872051:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+25:3653:x1870607944973440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951201.872064:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951201.872070:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 25 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872078:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 25 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872094:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608600/0x7645c8e1169f93b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f93b1 expref: 25 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872108:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951201.872189:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3653:x1870607944973440:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.872196:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951201.872212:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951201.872218:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+23:3653:x1870607944973312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951201.872225:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951201.872229:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 23 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872239:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 23 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872249:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030e00/0x7645c8e1169f93c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f93bf expref: 23 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872265:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872273:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783951201.872288:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009725357s 00010000:00010000:0.0:1783951201.872292:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872299:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872306:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872313:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872319:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951201.872323:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872331:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872344:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872352:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951201.872377:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+22:3653:x1870607944973312:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951201.872384:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951201.872423:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944973312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951201.872433:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944973440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951201.872459:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872467:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951201.872474:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948800/0x7645c8e1169f950f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1783951201.876789:0:19521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783951201.880451:0:19521:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783951201.880461:0:19521:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783951201.880503:0:19521:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783951201.880547:0:19521:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783951201.880582:0:19521:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1783951201.880601:0:19521:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783951201.881592:0:19521:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951201.881851:0:19521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783951201.894211:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944973568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951201.894285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951201.894340:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951201.894347:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944973696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951201.894371:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951201.894424:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973568 00000100:00100000:1.0:1783951201.894432:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973568 00000100:00100000:1.0:1783951201.894483:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973696 00000100:00100000:1.0:1783951201.894487:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973696 00000100:00100000:1.0:1783951201.894502:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951201.894511:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944973568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951201.894547:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951201.894603:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944973568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.894611:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951201.894627:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783951201.894633:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944973696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951201.894650:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951201.894678:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944973696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951201.894684:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783951201.894728:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944973696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951201.894739:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944973568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783951202.592826:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951202.657074:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1783951202.672808:0:19587:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783951202.673328:0:19587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951203.616340:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951203.680330:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783951203.680341:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e024667e000 from 10 10000000:01000000:3.0:1783951203.680349:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951203.680425:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951203.680439:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951203.680451:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951203.680488:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944973824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951203.680595:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951203.680657:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb23240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951203.680770:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973824 00000100:00100000:1.0:1783951203.680782:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973824 00000100:00100000:1.0:1783951203.680856:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783951203.680884:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944973824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951203.680904:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951203.680920:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f951d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9516 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951203.681171:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f951d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9516 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951203.681187:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f951d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9516 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951203.681198:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951203.681259:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944973824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 378us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951203.681267:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783951203.681389:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944973824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951203.681418:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951203.681427:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951203.681487:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944973952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951203.681524:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951203.681559:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951203.681821:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944973952 00000100:00100000:3.0:1783951203.681827:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944973952 00000100:00100000:3.0:1783951203.681868:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783951203.681877:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944973952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951203.681905:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951203.681925:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951203.681928:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1783951203.682352:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944973952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 475us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951203.682362:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783951203.682565:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944973952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951203.682640:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951203.682650:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951203.682661:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951203.682672:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951203.682674:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0248309800 from 10 10000000:01000000:2.0:1783951203.682677:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951203.682703:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951203.682722:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951203.682733:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951203.682816:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944974080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951203.682849:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951203.682925:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ef8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783951203.683068:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974080 00000100:00100000:1.0:1783951203.683075:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974080 00000100:00100000:1.0:1783951203.683171:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783951203.683181:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944974080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951203.683192:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951203.683207:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f952b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9524 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951203.683229:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f952b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9524 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951203.683239:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f952b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9524 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951203.683259:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951203.683297:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944974080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951203.683303:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783951203.683376:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944974080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951203.683388:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951203.683397:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951203.683448:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944974208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951203.683478:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951203.683576:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb23780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951203.683603:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974208 00000100:00100000:2.0:1783951203.683607:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974208 00000100:00100000:2.0:1783951203.683629:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783951203.683635:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944974208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951203.683648:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951203.683663:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951203.683667:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1783951203.683750:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944974208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951203.683758:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783951203.684260:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944974208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951203.684327:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951203.684335:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951203.684344:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951204.640313:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951205.473616:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951205.473638:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944974336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951205.473712:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951205.473757:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974336 00000100:00100000:0.0:1783951205.473765:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974336 00000100:00100000:0.0:1783951205.473825:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951205.473833:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944974336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951205.473870:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951205.473913:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944974336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951205.473921:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783951205.473941:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951205.473977:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944974336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783951205.664338:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951206.497306:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944974464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951206.497377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951206.497444:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974464 00000100:00100000:0.0:1783951206.497452:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974464 00000100:00100000:0.0:1783951206.497503:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951206.497531:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944974464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951206.497553:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951206.497597:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944974464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951206.497603:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783951206.497623:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951206.497660:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944974464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783951206.689972:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951207.008349:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944974592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951207.008425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951207.008471:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951207.008478:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944974720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951207.008500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951207.008545:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974592 00000100:00100000:1.0:1783951207.008553:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974592 00000100:00100000:1.0:1783951207.008589:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974720 00000100:00100000:1.0:1783951207.008592:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974720 00000100:00100000:1.0:1783951207.008607:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951207.008614:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944974592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951207.008647:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951207.008688:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944974592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951207.008695:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951207.008711:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951207.008717:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944974720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951207.008734:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951207.008775:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944974720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951207.008781:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951207.008835:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944974720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951207.008847:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944974592:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783951207.011726:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951207.011733:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783951207.011737:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951207.011746:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:2.0:1783951207.011750:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951207.011757:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0342df7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951207.011780:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc67480 x1870607944974976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951207.011821:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951207.011824:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783951207.011826:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951207.011830:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 557 00000100:00080000:2.0:1783951207.011832:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951207.011836:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0380fb7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951207.011847:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024856b100 x1870607944975360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951207.011953:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944974848:0@lo:400:kworker.0 00000100:00100000:2.0:1783951207.012091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.012137:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944975616:0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.012200:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944974976:0@lo:8:kworker.0 00000100:00100000:3.0:1783951207.012233:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951207.012254:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944975360:0@lo:8:kworker.0 00000100:00100000:3.0:1783951207.012278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951207.012280:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974848 00000100:00100000:3.0:1783951207.012322:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944975104:0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.012348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951207.012358:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974848 00000100:00100000:3.0:1783951207.012364:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944975744:0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.012382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951207.012420:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944974976 00000100:00100000:3.0:1783951207.012424:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944974976 00000100:00100000:3.0:1783951207.012446:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975360 00000100:00100000:3.0:1783951207.012448:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975360 00000100:00100000:3.0:1783951207.012467:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951207.012474:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607944974976:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783951207.012514:0:18707:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:3.0:1783951207.012544:0:18707:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9532 00002000:00100000:3.0:1783951207.012556:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e02478fe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783951207.012561:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783951207.012564:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783951207.012619:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783951207.012627:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3652:x1870607944974848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951207.012667:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3652:x1870607944974848:12345-0@lo:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951207.012673:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783951207.012704:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951207.012709:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607944975360:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783951207.012723:0:19194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00002000:00080000:3.0:1783951207.012728:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000020:00000080:1.0:1783951207.012740:0:19194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9539 00002000:00100000:1.0:1783951207.012746:0:19194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e024762c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00080000:3.0:1783951207.012749:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e02478fe000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1783951207.012749:0:19194:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1783951207.012750:0:19194:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783951207.012786:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607944974976:12345-0@lo:8:kworker.0 Request processed in 311us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.012793:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951207.012811:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975104 00000100:00100000:3.0:1783951207.012815:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975104 00000100:00100000:3.0:1783951207.012837:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975744 00000100:00100000:3.0:1783951207.012840:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975744 00000100:00100000:3.0:1783951207.012868:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951207.012874:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944975104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.012909:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944975104:12345-0@lo:400:kworker.0 Request processed in 34us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.012915:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951207.012927:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951207.012933:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944975744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.012960:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944975744:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.012973:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1783951207.013002:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783951207.013114:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc66300 x1870607944975104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951207.013128:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944975104:0@lo:400:kworker.0 00010000:00080000:3.0:1783951207.013138:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248569500 x1870607944975744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951207.013172:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944975744:0@lo:400:kworker.0 00010000:00080000:3.0:1783951207.013200:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc67480 x1870607944974976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951207.013208:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951207.013214:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783951207.013221:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783951207.013226:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783951207.013228:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783951207.013248:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783951207.013252:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944974976:0@lo:8:kworker.0 00000100:00100000:2.0:1783951207.013394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.013459:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944974848:0@lo:400:kworker.0 00000004:00080000:2.0:1783951207.013486:0:17225:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783951207.013498:0:17226:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1783951207.013534:0:17226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1870607944976256:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783951207.013559:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783951207.013568:0:17225:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 562661425310ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783951207.013574:0:17225:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783951207.013574:0:17226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951207.013712:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944975488:0@lo:400:kworker.0 00000100:00100000:2.0:1783951207.013734:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.013791:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944976000:0@lo:400:kworker.0 00002000:00080000:1.0:1783951207.013804:0:19194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1783951207.013826:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783951207.013829:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e024762d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951207.013847:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975616 00000100:00100000:3.0:1783951207.013851:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975616 00000100:00100000:1.0:1783951207.013867:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607944975360:12345-0@lo:8:kworker.0 Request processed in 1156us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951207.013873:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951207.013879:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975488 00000100:00100000:3.0:1783951207.013881:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975488 00000100:00100000:1.0:1783951207.013884:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976256 00000100:00100000:1.0:1783951207.013887:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976256 00000100:00100000:3.0:1783951207.013896:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951207.013902:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944975616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951207.013905:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951207.013909:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17226:x1870607944976256:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951207.013930:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944975616:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.013941:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951207.013953:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783951207.013957:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944975488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.013981:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944975488:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.013987:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1783951207.014006:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951207.014009:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951207.014111:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976000 00000100:00100000:1.0:1783951207.014114:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976000 00010000:00080000:2.0:1783951207.014119:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248569c00 x1870607944975488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783951207.014250:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024856b100 x1870607944975360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951207.014259:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951207.014264:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783951207.014270:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783951207.014274:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783951207.014276:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783951207.014286:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783951207.014290:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607944975360:0@lo:8:kworker.0 00000004:00080000:3.0:1783951207.014317:0:17944:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783951207.014329:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870607944976512:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1783951207.014349:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951207.014361:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb23d80 going to sleep for 11 seconds 00000004:00080000:3.0:1783951207.014370:0:17943:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783951207.014420:0:17943:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 562662277155ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783951207.014425:0:17943:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783951207.014530:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976512 00000100:00100000:3.0:1783951207.014535:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976512 00000100:00100000:2.0:1783951207.014581:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944975488:0@lo:400:kworker.0 00000100:00100000:2.0:1783951207.014591:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783951207.014599:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944975232:0@lo:400:kworker.0 00000100:00100000:2.0:1783951207.014623:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.014640:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944975872:0@lo:400:kworker.0 00000100:00100000:2.0:1783951207.014659:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.014681:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975872 00000100:00100000:2.0:1783951207.014685:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975872 00000100:00100000:3.0:1783951207.014731:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944975232 00000100:00100000:3.0:1783951207.014735:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944975232 00000100:00100000:1.0:1783951207.014748:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951207.014750:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951207.014754:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944976000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951207.014755:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944975232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951207.014787:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944976000:12345-0@lo:400:kworker.0 Request processed in 33us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.014788:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944975232:12345-0@lo:400:kworker.0 Request processed in 31us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.014795:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951207.014795:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951207.014807:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951207.014813:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1870607944976512:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1783951207.014847:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951207.014850:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951207.014852:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951207.014854:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951207.014862:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944976384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951207.014886:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951207.014916:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951207.014921:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944976128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951207.014940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951207.014965:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976384 00000100:00100000:3.0:1783951207.014968:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976384 00000100:00100000:3.0:1783951207.014982:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976128 00000100:00100000:3.0:1783951207.014984:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976128 00000100:00100000:3.0:1783951207.014994:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951207.014999:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1870607944976384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951207.015028:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783951207.015059:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1870607944976384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.015065:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951207.015081:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951207.015087:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607944976128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951207.015096:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783951207.015116:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607944976128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951207.015121:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783951207.015159:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e03489c7800 x1870607944976128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951207.015173:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944976128:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783951207.015183:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024860ca80 x1870607944976384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951207.015191:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944976384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951207.015361:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951207.015368:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944975872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951207.015402:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944975872:12345-0@lo:400:kworker.0 Request processed in 33us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951207.021318:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951207.021498:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944975232:0@lo:400:kworker.0 00010000:00080000:2.0:1783951207.021531:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248568380 x1870607944975872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951207.021556:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944975872:0@lo:400:kworker.0 00010000:00080000:2.0:1783951207.021572:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024856aa00 x1870607944976000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951207.021580:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944976000:0@lo:400:kworker.0 00010000:00080000:2.0:1783951207.021629:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024856a300 x1870607944975616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951207.021638:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944975616:0@lo:400:kworker.0 00000004:00080000:2.0:1783951207.023195:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1783951207.024582:0:19194:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1783951207.024595:0:19194:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1783951207.024602:0:19194:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:2.0:1783951207.024907:0:18709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783951207.024915:0:18709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783951207.025007:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1870607944976512:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10190us (10653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951207.025031:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783951207.025085:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc66d80 x1870607944976512/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783951223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951207.025100:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870607944976512:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1783951207.025113:0:17944:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783951207.025180:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870607944976640:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1783951207.025215:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.025237:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951207.025254:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976640 00000100:00100000:2.0:1783951207.025260:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976640 00000100:00100000:2.0:1783951207.025294:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951207.025303:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17944:x1870607944976640:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783951207.025334:0:18708:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1783951207.025364:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17944:x1870607944976640:12345-0@lo:5:osp-pre-1-1.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951207.025371:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783951207.025396:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024856a300 x1870607944976640/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951223 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951207.025405:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870607944976640:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1783951207.025413:0:17944:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783951207.025435:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870607944976768:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1783951207.025456:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951207.025470:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951207.025481:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976768 00000100:00100000:2.0:1783951207.025484:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976768 00000100:00100000:2.0:1783951207.025522:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951207.025530:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1870607944976768:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783951207.025560:0:18709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:3.0:1783951207.027273:0:17932:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1783951207.036728:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951207.036748:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.036772:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1783951207.036778:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951207.036786:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.036807:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.036819:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.036828:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.036873:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.037628:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.037639:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.037651:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.037657:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.037668:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.037691:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.037705:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9540 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.037729:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.037731:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.037733:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.038568:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.038578:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038591:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.038595:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.038601:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038614:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038630:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038638:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038656:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951207.038667:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951207.038672:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038680:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951207.038684:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038693:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038707:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038715:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f9547 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.038732:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.038739:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.038741:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.039240:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.039247:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.039257:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.039261:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.039266:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.039275:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.039285:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.039292:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.039313:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951207.040278:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.040289:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.040302:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.040307:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.040312:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.040334:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.040344:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.040352:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.040521:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951207.040559:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951207.040573:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040588:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.040594:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040607:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040629:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040638:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d476a1e/0x7645c8e1169f954e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040660:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.040665:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040688:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.040691:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040699:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040710:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040717:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f022867b/0x7645c8e1169f9555 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.040729:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.040731:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.040733:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.041379:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.041391:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.041405:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.041410:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.041416:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.041428:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.041437:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.041476:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.041499:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.041523:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.041532:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.041541:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.041545:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.041555:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.041577:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.041584:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b5a8590/0x7645c8e1169f955c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.041602:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.041605:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.041608:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.042089:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.042097:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042108:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.042111:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.042116:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042125:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042133:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042164:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042181:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.042282:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.042351:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042362:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.042366:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042376:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042457:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042466:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4842499/0x7645c8e1169f9563 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042497:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.042499:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.042515:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.042527:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.042535:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042551:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.042554:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.042559:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042569:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042576:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042584:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.042603:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.042627:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.042635:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042644:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.042648:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042659:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042672:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042680:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eaa2533/0x7645c8e1169f956a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.042695:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.042696:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.042699:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.043049:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.043057:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043065:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.043068:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.043072:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043081:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043100:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043107:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043125:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.043551:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.043560:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.043582:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.043587:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951207.043591:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.043606:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.043610:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043643:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.043649:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.043655:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.043656:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.043696:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f9571 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043697:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.043733:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.043739:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.043741:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.043744:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.043746:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.043985:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.044011:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.044018:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.044028:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.044032:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.044044:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.044065:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.044073:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9578 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.044087:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.044090:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.044094:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.044612:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.044621:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.044632:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.044636:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.044641:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.044650:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.044659:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.044667:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.046136:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951207.047343:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.047368:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.047387:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.047402:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.047410:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.047427:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.047438:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.047446:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049596:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951207.049612:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049628:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.049633:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049646:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049675:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049683:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f957f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049712:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.049716:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049724:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.049727:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049757:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049768:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.049775:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.049777:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.049779:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.052409:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783951207.052427:0:19194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f9586 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.052690:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.052932:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.052940:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.052958:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.052963:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.052971:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.052985:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.053000:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.053005:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.054328:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951207.054854:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951207.054871:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.054886:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951207.054892:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.054903:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.054923:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.054931:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f958d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.054995:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.054997:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.054999:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.055685:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951207.058322:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.058339:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.058361:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.058367:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.058377:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.058395:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.058407:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.058415:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.059875:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951207.060403:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951207.060414:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.060429:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951207.060435:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.060446:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.060471:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.060479:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f874dfb6/0x7645c8e1169f9594 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.060512:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.060521:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.060523:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951207.062864:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.062878:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.062912:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.062917:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.062924:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.062939:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.062950:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.062958:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.063026:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951207.064252:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.064262:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.064278:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.064283:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.064289:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.064301:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.064324:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.064331:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.065908:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951207.065924:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.065939:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.065944:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.065956:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.065982:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.065991:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd0619c/0x7645c8e1169f959b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.066034:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.066039:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.066046:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.066050:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.066063:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.066075:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.066083:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.066085:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.066087:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.066970:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951207.067168:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783951207.067181:0:19194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a11d2d/0x7645c8e1169f95a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783951207.068897:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.068910:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.068932:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.068937:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.068944:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.068960:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.068972:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.068996:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.069024:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951207.069485:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.069492:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.069514:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.069518:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.069522:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.069532:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.069541:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.069548:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.069563:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783951207.070517:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.070528:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.070550:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.070554:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.070560:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.070571:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.070581:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.070590:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.070601:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783951207.071579:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951207.071589:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.071603:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1783951207.071607:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951207.071612:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.071623:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.071645:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.071654:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951207.071665:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783951207.072309:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783951207.072320:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072331:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951207.072337:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072357:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072380:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072388:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7adfe62/0x7645c8e1169f95a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072413:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951207.072417:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072423:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951207.072425:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072446:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072457:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072465:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f40bddfd/0x7645c8e1169f95b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072479:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951207.072483:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072490:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951207.072493:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072501:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072521:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072529:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155eee60/0x7645c8e1169f95b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072554:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951207.072557:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072563:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951207.072566:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072574:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072584:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072589:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f95be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.072599:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.072600:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.072601:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.077264:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.077624:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.077638:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.077660:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.077666:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.077683:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.077701:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.077714:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.077722:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.077755:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951207.078304:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.078310:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078320:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.078324:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.078328:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078338:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078346:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078460:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078480:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783951207.078741:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.078747:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078756:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.078759:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.078763:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078771:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078779:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078786:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.078794:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783951207.079015:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951207.079025:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079033:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.079038:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079061:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079081:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079089:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c661cca/0x7645c8e1169f95c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079109:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951207.079112:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079118:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.079121:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079128:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079137:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079159:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f95cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079182:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.079185:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079191:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.079195:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079202:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079212:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079218:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f4d5f18/0x7645c8e1169f95d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.079229:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.079230:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.079232:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.079670:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.079678:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.079694:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.079698:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.079704:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.079715:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.079724:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.079731:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.079754:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951207.080053:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.080059:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080068:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.080078:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080087:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080100:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080107:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd7b6/0x7645c8e1169f95da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080122:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.080124:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.080126:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.080730:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.080738:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.080748:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.080753:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.080757:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.080767:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.080785:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.080793:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.080811:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951207.080968:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.080974:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080982:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.080986:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.080994:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.081006:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.081019:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009520f2df/0x7645c8e1169f95e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.081034:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.081036:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.081038:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.081878:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.081887:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.081900:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.081904:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.081909:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.081919:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.081928:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.081936:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.081965:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951207.082114:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.082120:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.082129:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.082133:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.082162:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.082178:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.082186:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24a57de/0x7645c8e1169f95e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.082203:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.082204:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.082206:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951207.082865:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.082873:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.082885:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.082888:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.082893:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.082904:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.082914:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.082922:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.083096:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951207.083525:0:19194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951207.083532:0:19194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.083541:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783951207.083551:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951207.083555:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.083566:0:19194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.083574:0:19194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951207.083582:0:19194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083653:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951207.083660:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083668:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.083673:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083682:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083699:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083706:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae2d0d97/0x7645c8e1169f95ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083726:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951207.083728:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083734:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951207.083736:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083744:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083767:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951207.083774:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.083776:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951207.083778:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951207.086080:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951207.088497:0:19194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783951207.088529:0:19194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000898d4782/0x7645c8e1169f95f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1783951207.088643:0:19194:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1783951207.088759:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17226:x1870607944976256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 74843us (75193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951207.088770:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1783951207.088842:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951207.089500:0:17226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1870607944976256:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783951207.089532:0:17226:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1783951207.089607:0:17226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1870607944976896:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783951207.089658:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951207.089688:0:17226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951207.090436:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944976896 00000100:00100000:2.0:1783951207.090449:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944976896 00000100:00100000:2.0:1783951207.090517:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951207.090530:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17226:x1870607944976896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783951207.090582:0:18707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:1.0:1783951207.092801:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1783951207.092885:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783951207.092891:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783951207.094814:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17944:x1870607944976768:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69059us (69130us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783951207.094831:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951207.094903:0:17944:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783951207.094914:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870607944976768:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783951207.094935:0:17944:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783951207.095001:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1870607944977024:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783951207.095046:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951207.095083:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342ee2300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951207.096462:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977024 00000100:00100000:0.0:1783951207.096475:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977024 00000100:00100000:0.0:1783951207.096546:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951207.096559:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1870607944977024:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783951207.096666:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1870607944977024:12345-0@lo:900:osp-pre-1-1.0 Request processed in 110us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951207.096674:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783951207.096829:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a2bb80 x1870607944977024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783951223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951207.096850:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1870607944977024:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783951207.108445:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17226:x1870607944976896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17905us (18773us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783951207.108469:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951207.113963:0:17226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1870607944976896:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783951207.114002:0:17226:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1783951207.712289:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951207.726874:0:19876:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1783951208.101447:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1783951208.588632:0:19929:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951208.618076:0:19929:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951208.737313:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783951209.531781:0:19979:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951209.532115:0:19979:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783951209.760319:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951209.883945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951209.884336:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923328 00000100:00100000:0.0:1783951209.884347:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923328 00000100:00100000:0.0:1783951209.884397:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 115 00000100:00100000:0.0:1783951209.884407:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1870607923923328:12345-192.168.202.33@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783951209.884439:0:17193:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e@192.168.202.33@tcp t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:0.0:1783951209.884472:0:17193:0:(genops.c:1406:class_connect()) connect: client ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e, cookie 0x7645c8e1169f95fd 00000100:00080000:0.0:1783951209.884628:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9e02481c4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951209.884701:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+5:2406:x1870607923923328:12345-192.168.202.33@tcp:250:mount.lustre.0 Request processed in 294us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951209.884710:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 115 00000100:00100000:0.0:1783951209.901051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951209.901138:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923456 00000100:00100000:1.0:1783951209.901188:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923456 00000100:00100000:1.0:1783951209.901244:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 116 00000100:00100000:1.0:1783951209.901255:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+5:14933:x1870607923923456:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951209.901273:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951209.901290:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f952 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951209.901321:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f952 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951209.901332:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f952 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951209.901343:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67c00, rc 0) 00000100:00100000:1.0:1783951209.901406:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+6:14933:x1870607923923456:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 151us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951209.901414:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 116 00000100:00100000:0.0:1783951209.919296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951209.919446:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923584 00000100:00100000:2.0:1783951209.919456:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923584 00000100:00100000:2.0:1783951209.919524:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:2.0:1783951209.919534:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+6:14933:x1870607923923584:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783951209.919671:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+6:14933:x1870607923923584:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 138us (385us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951209.919680:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:3.0:1783951209.924267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951209.924449:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923712 00000100:00100000:1.0:1783951209.924461:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923712 00000100:00100000:1.0:1783951209.924537:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:1.0:1783951209.924548:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+6:14933:x1870607923923712:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951209.924566:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951209.924596:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f960b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f959 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951209.924649:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f960b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f959 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951209.924663:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f960b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f959 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951209.924675:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67400, rc 0) 00000100:00100000:1.0:1783951209.924747:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+7:14933:x1870607923923712:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 201us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951209.924755:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:2.0:1783951209.927356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951209.927451:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923840 00000100:00100000:0.0:1783951209.927460:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923840 00000100:00100000:0.0:1783951209.927607:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:0.0:1783951209.927619:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+7:14933:x1870607923923840:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783951209.927792:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14933:x1870607923923840:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 174us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951209.927800:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:3.0:1783951209.929929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951209.936108:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923923968 00000100:00100000:1.0:1783951209.936127:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923923968 00000100:00100000:3.0:1783951209.938822:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:3.0:1783951209.938836:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14933:x1870607923923968:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783951209.938979:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14933:x1870607923923968:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 147us (9061us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951209.938986:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:3.0:1783951209.944847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951209.944968:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924096 00000100:00100000:0.0:1783951209.944983:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924096 00000100:00100000:0.0:1783951209.945052:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:0.0:1783951209.945062:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14952:x1870607923924096:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951209.945572:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14952:x1870607923924096:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 508us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951209.945582:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:0.0:1783951209.977400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951209.978083:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924224 00000100:00100000:2.0:1783951209.978098:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924224 00000100:00100000:2.0:1783951209.978212:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:2.0:1783951209.978236:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14952:x1870607923924224:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951209.978573:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14952:x1870607923924224:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 335us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951209.978586:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:3.0:1783951209.981226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951209.981355:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924352 00000100:00100000:2.0:1783951209.981371:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924352 00000100:00100000:2.0:1783951209.981457:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:2.0:1783951209.981470:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14952:x1870607923924352:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951209.981672:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14952:x1870607923924352:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 205us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951209.981690:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:3.0:1783951209.986363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951209.997510:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924480 00000100:00100000:0.0:1783951209.997529:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924480 00000100:00100000:0.0:1783951209.997737:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:0.0:1783951209.997752:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:14933:x1870607923924480:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783951209.997776:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951209.997799:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5d200/0x7645c8e1169f9612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f98a expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951209.997836:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5d200/0x7645c8e1169f9612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f98a expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951209.997849:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5d200/0x7645c8e1169f9612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f98a expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951209.997880:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5d200, rc 0) 00000100:00100000:0.0:1783951209.997966:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+9:14933:x1870607923924480:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 218us (11617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951209.997974:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:0.0:1783951210.005197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951210.005301:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924608 00000100:00100000:1.0:1783951210.005314:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924608 00000100:00100000:1.0:1783951210.005391:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:1.0:1783951210.005403:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+9:14933:x1870607923924608:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783951210.005437:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783951210.005679:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783951210.005683:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783951210.005687:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783951210.005690:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783951210.005692:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783951210.008835:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+9:14933:x1870607923924608:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 3418us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951210.008852:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:3.0:1783951210.018423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951210.018958:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924736 00000100:00100000:0.0:1783951210.018974:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924736 00000100:00100000:0.0:1783951210.019106:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:0.0:1783951210.019122:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+9:14933:x1870607923924736:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783951210.019574:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951210.019726:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f991 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951210.019787:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951210.019799:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951210.019809:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67200, rc 0) 00000100:00100000:1.0:1783951210.019892:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14933:x1870607923924736:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 774us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951210.019900:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:0.0:1783951210.023245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951210.023903:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924864 00000100:00100000:1.0:1783951210.023915:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924864 00000100:00100000:1.0:1783951210.023985:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:1.0:1783951210.023997:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14933:x1870607923924864:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951210.025186:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14933:x1870607923924864:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 1184us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951210.025200:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:2.0:1783951210.028083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951210.028273:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923924992 00000100:00100000:3.0:1783951210.028283:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923924992 00000100:00100000:3.0:1783951210.028356:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:3.0:1783951210.028367:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0348a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14933:x1870607923924992:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783951210.028534:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0348a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14933:x1870607923924992:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 169us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951210.028543:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:1.0:1783951210.032751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951210.033668:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925120 00000100:00100000:3.0:1783951210.033682:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925120 00000100:00100000:3.0:1783951210.033807:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:3.0:1783951210.033819:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14954:x1870607923925120:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951210.034050:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14954:x1870607923925120:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 232us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951210.034059:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:2.0:1783951210.054913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951210.055715:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925248 00000100:00100000:3.0:1783951210.055729:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925248 00000100:00100000:3.0:1783951210.055804:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:3.0:1783951210.055817:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14954:x1870607923925248:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951210.056842:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:14954:x1870607923925248:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 1023us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951210.056855:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:2.0:1783951210.066360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951210.066486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951210.066609:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925376 00000100:00100000:0.0:1783951210.066622:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925376 00000100:00100000:0.0:1783951210.066673:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925632 00000100:00100000:0.0:1783951210.066677:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925632 00000100:00100000:0.0:1783951210.066705:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:0.0:1783951210.066716:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870607923925376:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783951210.066757:0:17199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 6e04e128-5618-477b-951f-a759707c8cef@192.168.202.33@tcp t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:0.0:1783951210.066826:0:17199:0:(genops.c:1406:class_connect()) connect: client 6e04e128-5618-477b-951f-a759707c8cef, cookie 0x7645c8e1169f9620 00000004:00100000:0.0:1783951210.066859:0:17199:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783951210.067135:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9e02481c4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951210.067262:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+6:2406:x1870607923925376:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 545us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951210.067272:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:0.0:1783951210.067292:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:0.0:1783951210.067312:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870607923925632:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783951210.067329:0:17199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 6e04e128-5618-477b-951f-a759707c8cef@192.168.202.33@tcp t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:0.0:1783951210.067361:0:17199:0:(genops.c:1406:class_connect()) connect: client 6e04e128-5618-477b-951f-a759707c8cef, cookie 0x7645c8e1169f9627 00000004:00100000:0.0:1783951210.067376:0:17199:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783951210.067531:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9e02481c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951210.067558:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+6:2406:x1870607923925632:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 244us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951210.067566:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:2.0:1783951210.073500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951210.073544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951210.073576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951210.073691:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925888 00000100:00100000:1.0:1783951210.073703:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925888 00000100:00100000:1.0:1783951210.073791:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925760 00000100:00100000:1.0:1783951210.073794:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925760 00000100:00100000:1.0:1783951210.073828:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1783951210.073840:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923925888:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783951210.073898:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951210.074004:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923925888:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 165us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951210.074044:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1783951210.074067:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:1.0:1783951210.074075:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:0:x1870607923925760:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783951210.074096:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951210.074132:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:0:x1870607923925760:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 58us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951210.074139:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1783951210.074443:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923925504 00000100:00100000:2.0:1783951210.074456:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923925504 00000100:00100000:2.0:1783951210.074504:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1783951210.074512:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:0:x1870607923925504:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783951210.074526:0:19450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783951210.074555:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:0:x1870607923925504:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 45us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951210.074562:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00080000:3.0:1783951210.074940:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951210.074945:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951210.080529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951210.081200:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926016 00000100:00100000:2.0:1783951210.081215:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926016 00000100:00100000:2.0:1783951210.081359:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1783951210.081373:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923926016:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783951210.081518:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923926016:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 146us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951210.081526:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1783951210.087267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951210.087373:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926400 00000100:00100000:0.0:1783951210.087385:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926400 00000100:00100000:0.0:1783951210.087458:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1783951210.087471:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923926400:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783951210.087618:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923926400:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 149us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951210.087628:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1783951210.096909:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951210.096980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951210.097039:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926144 00000100:00100000:0.0:1783951210.097053:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926144 00000100:00100000:0.0:1783951210.097105:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926272 00000100:00100000:0.0:1783951210.097109:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926272 00000100:00100000:0.0:1783951210.097138:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951210.097201:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870607923926144:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783951210.097244:0:18708:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 6e04e128-5618-477b-951f-a759707c8cef@192.168.202.33@tcp t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:0.0:1783951210.097287:0:18708:0:(genops.c:1406:class_connect()) connect: client 6e04e128-5618-477b-951f-a759707c8cef, cookie 0x7645c8e1169f962e 00000100:00100000:3.0:1783951210.097312:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:3.0:1783951210.097320:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870607923926272:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783951210.097340:0:19194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6e04e128-5618-477b-951f-a759707c8cef@192.168.202.33@tcp t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:3.0:1783951210.097375:0:19194:0:(genops.c:1406:class_connect()) connect: client 6e04e128-5618-477b-951f-a759707c8cef, cookie 0x7645c8e1169f9635 00002000:00100000:3.0:1783951210.097381:0:19194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e04e128-5618-477b-951f-a759707c8cef/ffff9e02478fd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783951210.097405:0:19194:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1783951210.097527:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e04e128-5618-477b-951f-a759707c8cef/ffff9e02481c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783951210.097549:0:18708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783951210.097703:0:19194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783951210.097744:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e02478fc800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1783951210.097776:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783951210.097795:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e02481c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951210.097833:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+6:2406:x1870607923926144:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 633us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951210.097837:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+6:2406:x1870607923926272:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 513us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951210.097843:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:3.0:1783951210.097852:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:2.0:1783951210.099247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951210.099408:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926528 00000100:00100000:3.0:1783951210.099420:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926528 00000100:00100000:3.0:1783951210.099488:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1783951210.099499:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923926528:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783951210.104011:0:17202:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4317us 00000004:00200000:3.0:1783951210.121381:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783951210.121574:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e128-5618-477b-951f-a759707c8cef+6:14933:x1870607923926528:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 22069us (22329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951210.121598:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1783951210.281398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951210.281600:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926656 00000100:00100000:1.0:1783951210.281614:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926656 00000100:00100000:2.0:1783951210.281883:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783951210.281913:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:14977:x1870607923926656:12345-192.168.202.33@tcp:101:mkdir.0 00010000:00010000:2.0:1783951210.281941:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951210.281976:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f963c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f9c2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951210.282061:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f9643 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951210.282080:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f9643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951210.282099:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f9643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951210.282447:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951210.282453:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951210.282507:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f9643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951210.282542:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f963c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9c2 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951210.282566:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f9643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9c2 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951210.282688:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:2.0:1783951210.282693:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951210.282699:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948a00, rc 0) 00000100:00100000:2.0:1783951210.282953:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+7:14977:x1870607923926656:12345-192.168.202.33@tcp:101:mkdir.0 Request processed in 1041us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951210.282975:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1783951210.592692:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951210.592719:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944977152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951210.592799:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951210.592952:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977152 00000100:00100000:0.0:1783951210.592961:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977152 00000100:00100000:0.0:1783951210.593027:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951210.593036:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944977152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951210.593062:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951210.593103:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944977152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951210.593111:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1783951210.593250:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951210.593289:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944977152:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783951210.785431:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951211.616785:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951211.616816:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944977280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951211.616914:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951211.617090:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977280 00000100:00100000:0.0:1783951211.617101:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977280 00000100:00100000:0.0:1783951211.617205:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951211.617217:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944977280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951211.617259:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951211.617322:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944977280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951211.617330:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783951211.617391:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951211.618851:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944977280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783951211.808748:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951212.128635:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951212.128668:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944977408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951212.128761:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951212.129158:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944977536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951212.129195:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951212.129575:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944977920:0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.129615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951212.129635:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944978432:0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.129658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951212.129679:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783951212.129685:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944978048:0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.129711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951212.129729:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944978560:0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.129750:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951212.129784:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978048 00000100:00100000:3.0:1783951212.129792:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978048 00000100:00100000:3.0:1783951212.129859:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951212.129869:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944978048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.129932:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944978048:12345-0@lo:400:kworker.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.129940:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951212.129970:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977920 00000100:00100000:3.0:1783951212.129974:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977920 00000100:00100000:3.0:1783951212.129997:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978432 00000100:00100000:3.0:1783951212.130000:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978432 00000100:00100000:3.0:1783951212.130012:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978560 00000100:00100000:3.0:1783951212.130014:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978560 00000100:00100000:3.0:1783951212.130028:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951212.130034:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944977920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.130066:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944977920:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.130072:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951212.130097:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1783951212.130402:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951212.130407:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951212.130420:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951212.130434:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944977792:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130480:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.130501:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944978304:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.130537:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944978816:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130563:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.130578:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783951212.130584:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944977664:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130616:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.130644:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944978176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130667:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.130685:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944978688:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130760:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.130780:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977792 00000100:00100000:0.0:1783951212.130785:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977792 00000100:00100000:0.0:1783951212.130813:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978176 00000100:00100000:0.0:1783951212.130815:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978176 00000100:00100000:0.0:1783951212.130831:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951212.130837:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944977792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130872:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944977792:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.130878:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951212.130889:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951212.130894:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944978176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130925:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944978176:12345-0@lo:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.130931:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783951212.130942:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951212.130969:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944978176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.130980:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944977792:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.131031:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977664 00000100:00100000:0.0:1783951212.131035:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977664 00000100:00100000:0.0:1783951212.131057:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783951212.131063:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944977664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.131093:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944977664:12345-0@lo:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.131098:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783951212.131185:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944978048:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.131199:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944977920:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.131246:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944977664:0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.132575:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944978432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.132678:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944978432:12345-0@lo:400:kworker.0 Request processed in 2574us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.132689:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951212.132721:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978304 00000100:00100000:3.0:1783951212.132728:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978304 00000100:00100000:3.0:1783951212.132756:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978816 00000100:00100000:3.0:1783951212.132758:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978816 00000100:00100000:3.0:1783951212.132787:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978688 00000100:00100000:3.0:1783951212.132790:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978688 00000100:00100000:3.0:1783951212.132804:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951212.132810:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944978560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.132841:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944978560:12345-0@lo:400:kworker.0 Request processed in 31us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.132847:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951212.132857:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951212.132863:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944978304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.132899:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944978304:12345-0@lo:400:kworker.0 Request processed in 36us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.132906:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951212.132916:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783951212.132922:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944978816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.132951:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944978816:12345-0@lo:400:kworker.0 Request processed in 29us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.132956:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783951212.132967:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783951212.132992:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944978688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.133023:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944978688:12345-0@lo:400:kworker.0 Request processed in 34us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.133029:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1783951212.133074:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951212.133079:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951212.133123:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944978688:0@lo:400:kworker.0 00000100:00100000:3.0:1783951212.133138:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944978304:0@lo:400:kworker.0 00010000:00080000:3.0:1783951212.133180:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbbf800 x1870607944978816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951212.133191:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944978816:0@lo:400:kworker.0 00010000:00080000:0.0:1783951212.134577:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fbbd880 x1870607944978560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951212.134595:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944978560:0@lo:400:kworker.0 00000100:00100000:0.0:1783951212.134610:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944978432:0@lo:400:kworker.0 00000100:00100000:1.0:1783951212.134749:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977408 00000100:00100000:1.0:1783951212.134757:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977408 00000100:00100000:1.0:1783951212.134809:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944977536 00000100:00100000:1.0:1783951212.134813:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944977536 00000100:00100000:1.0:1783951212.134827:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951212.134834:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944977408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951212.134876:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951212.134956:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944977408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (6194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.134963:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951212.134981:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951212.134987:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944977536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951212.135005:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951212.135052:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944977536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (5856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.135058:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951212.135537:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944978944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951212.135586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.135628:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951212.135635:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944979072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951212.135658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951212.135686:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944978944 00000100:00100000:0.0:1783951212.135691:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944978944 00000100:00100000:0.0:1783951212.135715:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979072 00000100:00100000:0.0:1783951212.135717:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979072 00000100:00100000:0.0:1783951212.135730:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951212.135736:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944978944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951212.135763:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783951212.135803:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944978944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.135809:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951212.135820:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951212.135826:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607944979072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951212.135835:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783951212.135855:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607944979072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.135861:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951212.135898:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944979072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951212.135911:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944978944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951212.137610:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944977536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951212.137639:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944977408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951212.528281:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.528420:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926784 00000100:00100000:3.0:1783951212.528435:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926784 00000100:00100000:3.0:1783951212.528584:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:3.0:1783951212.528598:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+7:15030:x1870607923926784:12345-192.168.202.33@tcp:41:lfs.0 00000004:00000024:3.0:1783951212.528650:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783951212.528766:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+7:15030:x1870607923926784:12345-192.168.202.33@tcp:41:lfs.0 Request processed in 172us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.528773:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00080000:0.0:1783951212.529336:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951212.531762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951212.532553:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923926912 00000100:00100000:2.0:1783951212.532566:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923926912 00000100:00100000:2.0:1783951212.532665:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1783951212.532678:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:15030:x1870607923926912:12345-192.168.202.33@tcp:41:lfs.0 00000004:00000024:2.0:1783951212.532800:0:19450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783951212.532923:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:15030:x1870607923926912:12345-192.168.202.33@tcp:41:lfs.0 Request processed in 248us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951212.532932:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00080000:0.0:1783951212.533774:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951212.537104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.537243:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927040 00000100:00100000:0.0:1783951212.537256:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927040 00000100:00080000:3.0:1783951212.537361:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951212.537423:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:0.0:1783951212.537450:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e128-5618-477b-951f-a759707c8cef+6:15030:x1870607923927040:12345-192.168.202.33@tcp:13:lfs.0 00002000:00000024:0.0:1783951212.537495:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951212.537703:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e128-5618-477b-951f-a759707c8cef+6:15030:x1870607923927040:12345-192.168.202.33@tcp:13:lfs.0 Request processed in 254us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.537712:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1783951212.541645:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951212.541913:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927168 00000100:00100000:1.0:1783951212.541927:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927168 00000100:00100000:1.0:1783951212.542019:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1783951212.542033:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e128-5618-477b-951f-a759707c8cef+6:15030:x1870607923927168:12345-192.168.202.33@tcp:13:lfs.0 00002000:00000024:1.0:1783951212.542069:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783951212.542203:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e128-5618-477b-951f-a759707c8cef+6:15030:x1870607923927168:12345-192.168.202.33@tcp:13:lfs.0 Request processed in 173us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.542212:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00080000:3.0:1783951212.542712:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783951212.832526:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951212.836004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.836788:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927296 00000100:00100000:0.0:1783951212.836813:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927296 00000100:00100000:0.0:1783951212.836897:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:0.0:1783951212.836911:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:15064:x1870607923927296:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783951212.836933:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951212.836957:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f964a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f9c9 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.836998:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f964a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9c9 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.837024:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f964a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9c9 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.837035:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5ca00, rc 0) 00000100:00100000:0.0:1783951212.837118:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15064:x1870607923927296:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 210us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.837127:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:2.0:1783951212.844884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951212.845437:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927424 00000100:00100000:1.0:1783951212.845510:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927424 00000100:00100000:1.0:1783951212.845625:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:1.0:1783951212.845637:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15064:x1870607923927424:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783951212.845877:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15064:x1870607923927424:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 241us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.845886:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:3.0:1783951212.849053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.849817:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927552 00000100:00100000:0.0:1783951212.849831:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927552 00000100:00100000:0.0:1783951212.850056:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:0.0:1783951212.850069:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15064:x1870607923927552:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783951212.850350:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15064:x1870607923927552:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 283us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.850359:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:2.0:1783951212.855580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951212.856068:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927680 00000100:00100000:1.0:1783951212.856081:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927680 00000100:00100000:1.0:1783951212.856182:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:1.0:1783951212.856195:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15069:x1870607923927680:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951212.857001:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15069:x1870607923927680:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 805us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.857024:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:2.0:1783951212.885332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.885530:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927808 00000100:00100000:0.0:1783951212.885541:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927808 00000100:00100000:0.0:1783951212.885599:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:0.0:1783951212.885607:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15069:x1870607923927808:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951212.885788:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15069:x1870607923927808:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 181us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.885796:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:3.0:1783951212.889194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951212.889630:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923927936 00000100:00100000:1.0:1783951212.889643:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923927936 00000100:00100000:1.0:1783951212.889708:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:1.0:1783951212.889720:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15069:x1870607923927936:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951212.890462:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15069:x1870607923927936:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 732us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.890474:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:2.0:1783951212.893227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.893398:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928064 00000100:00100000:0.0:1783951212.893411:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928064 00000100:00100000:0.0:1783951212.893546:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:0.0:1783951212.893556:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:15064:x1870607923928064:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783951212.893576:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951212.893595:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5da00/0x7645c8e1169f9651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3f9fa expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.893624:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5da00/0x7645c8e1169f9651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9fa expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.893633:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5da00/0x7645c8e1169f9651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9fa expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.893640:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5da00, rc 0) 00000100:00100000:0.0:1783951212.893700:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:15064:x1870607923928064:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 145us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.893725:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1783951212.895922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951212.895977:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928192 00000100:00100000:1.0:1783951212.895990:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928192 00000100:00100000:1.0:1783951212.896055:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:1.0:1783951212.896066:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:15064:x1870607923928192:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783951212.896097:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783951212.896128:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783951212.896132:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783951212.896135:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783951212.896139:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783951212.896163:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1783951212.898255:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:15064:x1870607923928192:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 2175us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951212.898272:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 139 00000040:00080000:1.0:1783951212.898634:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951212.901589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.901660:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928320 00000100:00100000:0.0:1783951212.901670:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928320 00000100:00100000:0.0:1783951212.901805:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:0.0:1783951212.901816:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:15064:x1870607923928320:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783951212.901834:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951212.901852:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa01 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.901889:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.901899:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951212.901907:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5cc00, rc 0) 00000100:00100000:0.0:1783951212.901966:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15064:x1870607923928320:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.901971:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:3.0:1783951212.903895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951212.903988:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928448 00000100:00100000:2.0:1783951212.903999:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928448 00000100:00100000:2.0:1783951212.904078:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:2.0:1783951212.904089:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15064:x1870607923928448:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783951212.904311:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15064:x1870607923928448:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 223us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951212.904319:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:3.0:1783951212.905815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.905877:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928576 00000100:00100000:0.0:1783951212.905885:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928576 00000100:00100000:2.0:1783951212.906899:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 142 00000100:00100000:2.0:1783951212.906918:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15064:x1870607923928576:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783951212.907116:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15064:x1870607923928576:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 204us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951212.907125:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 142 00000100:00100000:0.0:1783951212.909533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951212.909726:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928704 00000100:00100000:1.0:1783951212.909738:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928704 00000100:00100000:1.0:1783951212.909799:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:1.0:1783951212.909811:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15071:x1870607923928704:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951212.910003:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15071:x1870607923928704:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 195us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.910022:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:3.0:1783951212.915654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951212.920066:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928832 00000100:00100000:2.0:1783951212.920088:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928832 00000100:00100000:2.0:1783951212.920195:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:2.0:1783951212.920210:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15071:x1870607923928832:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951212.920434:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:15071:x1870607923928832:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 228us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951212.920444:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:3.0:1783951212.933786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.933841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.933873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.933909:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.933941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.933967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.934005:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929856 00000100:00100000:3.0:1783951212.934018:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929856 00000100:00100000:3.0:1783951212.934076:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929984 00000100:00100000:3.0:1783951212.934079:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929984 00000100:00100000:3.0:1783951212.934108:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:3.0:1783951212.934121:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923929856:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951212.934285:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923929856:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 166us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.934299:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:3.0:1783951212.934319:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951212.934326:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923929984:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951212.934352:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923929984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.934358:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951212.934497:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923928960 00000100:00100000:3.0:1783951212.934501:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923928960 00000100:00100000:3.0:1783951212.934534:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929216 00000100:00100000:3.0:1783951212.934538:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929216 00000100:00100000:3.0:1783951212.934544:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929600 00000100:00100000:3.0:1783951212.934546:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929600 00000100:00100000:3.0:1783951212.934562:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929728 00000100:00100000:3.0:1783951212.934565:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929728 00000100:00100000:3.0:1783951212.934578:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:3.0:1783951212.934582:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+7:2410:x1870607923929600:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951212.934615:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+7:2410:x1870607923929600:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 32us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.934622:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:3.0:1783951212.934633:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:3.0:1783951212.934640:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923929728:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951212.934683:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923929728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 42us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.934690:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:3.0:1783951212.934702:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:3.0:1783951212.934707:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870607923928960:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783951212.934734:0:19450:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a956fd71-c100-46a9-957b-d126f21246ff@192.168.202.33@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:3.0:1783951212.934777:0:19450:0:(genops.c:1406:class_connect()) connect: client a956fd71-c100-46a9-957b-d126f21246ff, cookie 0x7645c8e1169f965f 00000004:00100000:3.0:1783951212.934813:0:19450:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783951212.934933:0:19450:0:(import.c:65:import_set_state_nolock()) ffff9e02478fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951212.934965:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2406:x1870607923928960:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 256us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.934972:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:3.0:1783951212.934986:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:3.0:1783951212.934998:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870607923929216:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783951212.935014:0:19450:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from a956fd71-c100-46a9-957b-d126f21246ff@192.168.202.33@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:3.0:1783951212.935039:0:19450:0:(genops.c:1406:class_connect()) connect: client a956fd71-c100-46a9-957b-d126f21246ff, cookie 0x7645c8e1169f9666 00000004:00100000:3.0:1783951212.935055:0:19450:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783951212.935120:0:19450:0:(import.c:65:import_set_state_nolock()) ffff9e036c57d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951212.935166:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2406:x1870607923929216:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 167us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.935172:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:3.0:1783951212.938649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.938690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.938721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.938831:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929472 00000100:00100000:0.0:1783951212.938843:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929472 00000100:00100000:0.0:1783951212.938922:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929344 00000100:00100000:0.0:1783951212.938926:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929344 00000100:00100000:0.0:1783951212.938945:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923929088 00000100:00100000:0.0:1783951212.938948:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923929088 00000100:00100000:0.0:1783951212.938984:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951212.938996:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+7:15064:x1870607923929472:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951212.939035:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783951212.939114:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+7:15064:x1870607923929472:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 120us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.939121:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951212.939138:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951212.939183:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:0:x1870607923929344:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951212.939209:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783951212.939238:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:0:x1870607923929344:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 56us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.939245:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951212.939257:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951212.939264:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:0:x1870607923929088:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951212.939274:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783951212.939305:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:0:x1870607923929088:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.939312:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00080000:3.0:1783951212.939714:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951212.939719:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951212.941624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.942402:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930112 00000100:00100000:3.0:1783951212.942415:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930112 00000100:00100000:3.0:1783951212.942501:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:3.0:1783951212.942513:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:15064:x1870607923930112:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783951212.942687:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:15064:x1870607923930112:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 177us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951212.942696:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:3.0:1783951212.949644:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.949695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951212.949736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.949895:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930496 00000100:00100000:1.0:1783951212.949898:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930240 00000100:00100000:1.0:1783951212.949907:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930240 00000100:00100000:0.0:1783951212.949907:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930496 00000100:00100000:1.0:1783951212.949951:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930368 00000100:00100000:1.0:1783951212.949954:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930368 00000100:00100000:0.0:1783951212.949961:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:1.0:1783951212.949973:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951212.949974:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a956fd71-c100-46a9-957b-d126f21246ff+6:15064:x1870607923930496:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783951212.949979:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870607923930240:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783951212.950012:0:18709:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a956fd71-c100-46a9-957b-d126f21246ff@192.168.202.33@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1783951212.950052:0:18709:0:(genops.c:1406:class_connect()) connect: client a956fd71-c100-46a9-957b-d126f21246ff, cookie 0x7645c8e1169f966d 00002000:00100000:1.0:1783951212.950066:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a956fd71-c100-46a9-957b-d126f21246ff/ffff9e024762e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1783951212.950075:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a956fd71-c100-46a9-957b-d126f21246ff+6:15064:x1870607923930496:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 105us (445us total) trans 0 rc 0/0 00002000:00100000:1.0:1783951212.950079:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783951212.950102:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:0.0:1783951212.950132:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783951212.950136:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870607923930368:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783951212.950178:0:18708:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a956fd71-c100-46a9-957b-d126f21246ff@192.168.202.33@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1783951212.950196:0:18708:0:(genops.c:1406:class_connect()) connect: client a956fd71-c100-46a9-957b-d126f21246ff, cookie 0x7645c8e1169f9674 00002000:00100000:0.0:1783951212.950201:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a956fd71-c100-46a9-957b-d126f21246ff/ffff9e0246bc9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783951212.950207:0:18708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951212.950231:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1783951212.950279:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951212.950313:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e0381192000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951212.950345:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a956fd71-c100-46a9-957b-d126f21246ff+6:2406:x1870607923930368:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 207us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.950352:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00080000:1.0:1783951212.950505:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9e024762f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951212.950531:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a956fd71-c100-46a9-957b-d126f21246ff+6:2406:x1870607923930240:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 552us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951212.950538:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:3.0:1783951212.955558:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951212.956040:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930624 00000100:00100000:0.0:1783951212.956051:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930624 00000100:00100000:0.0:1783951212.956114:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:0.0:1783951212.956125:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956fd71-c100-46a9-957b-d126f21246ff+6:15064:x1870607923930624:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783951212.956755:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783951212.957098:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956fd71-c100-46a9-957b-d126f21246ff+6:15064:x1870607923930624:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 970us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951212.957108:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000001:00100000:1.0:1783951212.961771:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000001:00100000:1.0:1783951212.961786:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000001:00080000:1.0:1783951212.961794:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1783951213.140795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951213.144866:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930752 00000100:00100000:2.0:1783951213.144882:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930752 00000100:00100000:2.0:1783951213.144973:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:2.0:1783951213.144984:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:15094:x1870607923930752:12345-192.168.202.33@tcp:101:mkdir.0 00010000:00010000:2.0:1783951213.145006:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951213.145026:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f967b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa32 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951213.145120:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951213.145134:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951213.145174:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951213.145224:0:19450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951213.145228:0:19450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951213.145247:0:19450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951213.145273:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f967b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 8 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951213.145779:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 7 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951213.145791:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:2.0:1783951213.145794:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951213.145798:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948800, rc 0) 00000100:00100000:2.0:1783951213.145887:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+7:15094:x1870607923930752:12345-192.168.202.33@tcp:101:mkdir.0 Request processed in 904us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951213.145896:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00010000:00010000:0.0:1783951213.857645:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951214.880364:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951215.712681:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951215.712719:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944979200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951215.712790:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951215.713000:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979200 00000100:00100000:0.0:1783951215.713009:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979200 00000100:00100000:0.0:1783951215.713078:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783951215.713088:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944979200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951215.713119:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951215.713183:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944979200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951215.713190:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1783951215.713882:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951215.713932:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944979200:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783951215.909110:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951216.231849:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000001:00100000:2.0:1783951216.231868:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000001:00100000:1.0:1783951216.242790:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000001:00100000:1.0:1783951216.242809:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000001:00100000:2.0:1783951216.244788:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000001:00100000:2.0:1783951216.244804:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000100:00100000:2.0:1783951216.736956:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951216.736991:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944979328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951216.737069:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951216.737131:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979328 00000100:00100000:2.0:1783951216.737139:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979328 00000100:00100000:2.0:1783951216.737215:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951216.737235:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944979328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951216.737267:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951216.737315:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944979328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951216.737603:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783951216.737628:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951216.737663:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944979328:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1783951216.744912:0:20077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783951216.928571:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951217.248795:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944979584:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.248859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249051:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944980096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249099:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944980608:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249123:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249168:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783951217.249174:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944979456:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249225:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944979968:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249263:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249278:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944980480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249679:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944979840:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249707:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249729:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944980352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249749:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249764:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944980864:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249781:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249794:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951217.249810:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944979712:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249833:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249847:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944980224:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249866:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249882:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944980736:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.249902:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951217.249944:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980608 00000100:00100000:3.0:1783951217.249951:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980608 00000100:00100000:3.0:1783951217.250000:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980480 00000100:00100000:3.0:1783951217.250003:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980480 00000100:00100000:3.0:1783951217.250017:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979840 00000100:00100000:3.0:1783951217.250019:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979840 00000100:00100000:3.0:1783951217.250030:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980352 00000100:00100000:3.0:1783951217.250032:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980352 00000100:00100000:3.0:1783951217.250039:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980864 00000100:00100000:3.0:1783951217.250041:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980864 00000100:00100000:3.0:1783951217.250053:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980736 00000100:00100000:3.0:1783951217.250055:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980736 00000100:00100000:3.0:1783951217.250071:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951217.250079:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944980608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951217.250215:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979584 00000100:00100000:1.0:1783951217.250219:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979584 00000100:00100000:1.0:1783951217.250259:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979968 00000100:00100000:1.0:1783951217.250268:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979968 00000100:00100000:1.0:1783951217.250285:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951217.250290:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944979584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951217.253691:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944980992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951217.253774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951217.253811:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951217.253818:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944981120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951217.253844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951217.253884:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980096 00000100:00100000:0.0:1783951217.253892:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980096 00000100:00100000:0.0:1783951217.253958:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979712 00000100:00100000:0.0:1783951217.253961:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979712 00000100:00100000:0.0:1783951217.253975:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980224 00000100:00100000:0.0:1783951217.253978:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980224 00000100:00100000:0.0:1783951217.253993:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951217.254001:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944980096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.254198:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944981248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951217.254241:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951217.254263:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951217.254270:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944981376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951217.254294:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951217.254331:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951217.254351:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944980480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.254387:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944980480:12345-0@lo:400:kworker.0 Request processed in 49us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254421:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951217.254443:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951217.254452:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944979840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.254485:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944979840:12345-0@lo:400:kworker.0 Request processed in 35us (4776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254490:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951217.254502:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951217.254509:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944980352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.254536:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944980352:12345-0@lo:400:kworker.0 Request processed in 29us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254542:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951217.254555:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951217.254563:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944980864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.254592:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944980864:12345-0@lo:400:kworker.0 Request processed in 32us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254598:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951217.254610:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783951217.254618:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.254649:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944980736:12345-0@lo:400:kworker.0 Request processed in 32us (4745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254654:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1783951217.254671:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951217.254675:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951217.254678:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951217.254680:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951217.254698:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944981120 00000100:00100000:2.0:1783951217.254702:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944981120 00000100:00100000:2.0:1783951217.254723:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944981248 00000100:00100000:2.0:1783951217.254725:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944981248 00000100:00100000:2.0:1783951217.254738:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951217.254744:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607944981120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951217.254768:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783951217.254801:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607944981120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254807:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951217.254822:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951217.254830:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944981248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951217.254838:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783951217.254865:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607944981248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.254870:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951217.254909:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944981248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951217.254936:0:3652:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783951217.254951:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944981120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951217.254989:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951217.254999:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944979712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.255029:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944979712:12345-0@lo:400:kworker.0 Request processed in 34us (5195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.255036:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951217.255049:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951217.255057:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944980224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.255093:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944980224:12345-0@lo:400:kworker.0 Request processed in 38us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.255099:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951217.255168:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944979456 00000100:00100000:2.0:1783951217.255172:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944979456 00000100:00100000:2.0:1783951217.255200:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783951217.255208:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3653:x1870607944979456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.255240:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3653:x1870607944979456:12345-0@lo:400:kworker.0 Request processed in 33us (6034us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951217.255245:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783951217.255287:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944979456:0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.255301:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944980480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.264937:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944980608:12345-0@lo:400:kworker.0 Request processed in 14847us (15801us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951217.264954:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951217.265176:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944979584:12345-0@lo:400:kworker.0 Request processed in 14883us (16314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951217.265176:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944980096:12345-0@lo:400:kworker.0 Request processed in 11172us (16091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951217.265187:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951217.265188:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951217.265220:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944980992 00000100:00100000:1.0:1783951217.265234:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944980992 00000100:00100000:1.0:1783951217.265269:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944981376 00000100:00100000:1.0:1783951217.265273:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944981376 00000100:00100000:1.0:1783951217.265290:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951217.265296:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944979968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951217.265382:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944979968:12345-0@lo:400:kworker.0 Request processed in 85us (16118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951217.265388:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951217.265400:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783951217.265405:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944980992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951217.265442:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951217.265500:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944980992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (11726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951217.265507:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783951217.265520:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951217.265526:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944981376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951217.265543:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783951217.265584:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944981376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (11289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951217.265590:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951217.265671:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944981376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951217.265709:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944979712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951217.265724:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944980224:0@lo:400:kworker.0 00000100:00100000:1.0:1783951217.265741:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944980736:0@lo:400:kworker.0 00000100:00100000:1.0:1783951217.265752:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944979840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951217.265761:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944980352:0@lo:400:kworker.0 00010000:00080000:1.0:1783951217.265775:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248395880 x1870607944980864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951217.265784:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944980864:0@lo:400:kworker.0 00000100:00100000:3.0:1783951217.266078:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944980992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951217.267494:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944979584:0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.267513:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944980096:0@lo:400:kworker.0 00010000:00080000:2.0:1783951217.267529:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248396d80 x1870607944980608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951217.267539:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944980608:0@lo:400:kworker.0 00000100:00100000:2.0:1783951217.267577:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944979968:0@lo:400:kworker.0 00010000:00010000:2.0:1783951217.955740:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951218.340123:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783951218.434067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951218.434121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951218.434177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951218.434206:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951218.434363:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931136 00000100:00100000:2.0:1783951218.434375:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931136 00000100:00100000:2.0:1783951218.434456:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931648 00000100:00100000:2.0:1783951218.434459:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931648 00000100:00100000:2.0:1783951218.434516:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:2.0:1783951218.434528:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923931136:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951218.434621:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923931136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 96us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951218.434629:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:2.0:1783951218.434653:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:2.0:1783951218.434662:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923931648:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951218.434684:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923931648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951218.434689:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00080000:2.0:1783951218.434816:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951218.434856:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931392 00000100:00100000:2.0:1783951218.434860:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931392 00000100:00100000:2.0:1783951218.434894:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1783951218.434903:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923931392:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951218.434931:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923931392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951218.434938:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00080000:2.0:1783951218.434956:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951218.435412:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923930880 00000100:00100000:0.0:1783951218.435417:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923930880 00000100:00100000:0.0:1783951218.435450:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:0.0:1783951218.435457:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923930880:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951218.435487:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923930880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951218.435503:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:3.0:1783951218.435648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951218.435686:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931904 00000100:00100000:3.0:1783951218.435690:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931904 00000100:00100000:3.0:1783951218.435725:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1783951218.435732:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923931904:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951218.435760:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923931904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951218.435766:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00080000:3.0:1783951218.435781:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951218.435887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951218.435930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951218.435960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951218.436018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951218.436112:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931264 00000100:00100000:0.0:1783951218.436117:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931264 00000100:00100000:0.0:1783951218.436169:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931776 00000100:00100000:0.0:1783951218.436173:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931776 00000100:00100000:0.0:1783951218.436195:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:0.0:1783951218.436202:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923931264:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951218.436233:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923931264:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951218.436240:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:0.0:1783951218.436612:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:0.0:1783951218.436621:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923931776:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951218.436649:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923931776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951218.436656:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:0.0:1783951218.436703:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931008 00000100:00100000:0.0:1783951218.436707:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931008 00000100:00100000:0.0:1783951218.436732:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923931520 00000100:00100000:0.0:1783951218.436735:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923931520 00000100:00100000:0.0:1783951218.436756:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:0.0:1783951218.436761:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923931008:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951218.436805:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2410:x1870607923931008:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 43us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951218.436811:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:0.0:1783951218.436822:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:0.0:1783951218.436828:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+6:2410:x1870607923931520:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951218.436849:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+6:2410:x1870607923931520:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951218.436855:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00080000:0.0:1783951218.436874:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951218.436877:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783951218.985628:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951220.006015:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951220.835850:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944981504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951220.835991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951220.837805:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944981504 00000100:00100000:2.0:1783951220.837822:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944981504 00000100:00100000:2.0:1783951220.837927:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951220.837958:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944981504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951220.838005:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951220.838093:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944981504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951220.838117:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783951220.838755:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944981504:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951220.838909:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951221.033935:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951221.856673:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951221.856698:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944981632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951221.856782:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951221.857343:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944981632 00000100:00100000:2.0:1783951221.857352:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944981632 00000100:00100000:2.0:1783951221.857462:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951221.857473:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944981632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951221.857496:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951221.857545:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944981632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951221.857552:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951221.857599:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944981632:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951221.857850:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1783951221.933177:0:20224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebbbc96e0 20000000:00000080:3.0:1783951221.933195:0:20224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e037201a000 uarg=0000000000000000 20000000:01000000:3.0:1783951221.933237:0:20224:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783951221.933242:0:20224:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783951221.933247:0:20224:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783951221.934734:0:20225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1783951221.938694:0:20224:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783951221.948681:0:20224:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783951221.960468:0:20224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960496:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960503:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960510:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960517:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960527:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960555:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960562:0:20224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960614:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960629:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 12 pid: 17192 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.960645:0:20224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944981760:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951221.960756:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960766:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 12 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.960775:0:20224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944981888:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951221.960809:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960817:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 23 pid: 17193 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.960826:0:20224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982016:0@lo:104: 00000100:00100000:2.0:1783951221.960867:0:20224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951221.960930:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960938:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 23 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.960946:0:20224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982144:0@lo:104: 00000100:00100000:2.0:1783951221.960968:0:20224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951221.960987:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.960995:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 23 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.961003:0:20224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982272:0@lo:104: 00000100:00100000:2.0:1783951221.961024:0:20224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951221.961040:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.961048:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 23 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.961058:0:20224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982400:0@lo:104: 00000100:00100000:2.0:1783951221.961075:0:20224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951221.961084:0:20224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03484f0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951221.961181:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982016 00000100:00100000:1.0:1783951221.961189:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982016 00000100:00100000:1.0:1783951221.961238:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982144 00000100:00100000:1.0:1783951221.961241:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982144 00000100:00100000:1.0:1783951221.961252:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982272 00000100:00100000:1.0:1783951221.961254:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982272 00000100:00100000:1.0:1783951221.961263:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982400 00000100:00100000:1.0:1783951221.961265:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982400 00000100:00100000:1.0:1783951221.961278:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951221.961287:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+6:20224:x1870607944982016:12345-0@lo:104: 00010000:00010000:1.0:1783951221.961299:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961357:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951221.961363:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+6:20224:x1870607944982016:12345-0@lo:104: Request processed in 78us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.961485:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951221.961504:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951221.961510:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+5:20224:x1870607944982144:12345-0@lo:104: 00010000:00010000:1.0:1783951221.961517:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961552:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783951221.961557:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+5:20224:x1870607944982144:12345-0@lo:104: Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.961562:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951221.961573:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951221.961579:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+4:20224:x1870607944982272:12345-0@lo:104: 00010000:00010000:1.0:1783951221.961585:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961608:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783951221.961613:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+4:20224:x1870607944982272:12345-0@lo:104: Request processed in 35us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.961618:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951221.961628:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951221.961633:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:20224:x1870607944982400:12345-0@lo:104: 00010000:00010000:1.0:1783951221.961640:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961663:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783951221.961667:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+3:20224:x1870607944982400:12345-0@lo:104: Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.961680:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783951221.961698:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783951221.961704:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961710:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951221.961714:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961722:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951221.961729:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951221.961735:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951221.961769:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961775:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951221.961793:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961799:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949600/0x7645c8e1169f94c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f94d0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961812:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951221.961816:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961832:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5dc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951221.961835:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961842:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951221.961848:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951221.961853:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951221.961868:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961873:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951221.961878:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961884:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5dc00/0x7645c8e1169f9364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f936b expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961893:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951221.961896:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961901:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951221.961904:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961919:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951221.961925:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951221.961930:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951221.961943:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961948:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951221.961962:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961969:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343609200/0x7645c8e1169f9325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f932c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961978:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951221.961981:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961987:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951221.961990:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.961996:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951221.962001:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951221.962011:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951221.962025:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962031:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951221.962037:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962042:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f9317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f931e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962054:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951221.962056:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951221.962057:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951221.962064:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951221.962081:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944982528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962112:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951221.962162:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951221.962168:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944982656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962190:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951221.962285:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944982784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951221.962329:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951221.962334:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944982912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951221.962396:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982528 00000100:00100000:1.0:1783951221.962400:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982528 00010000:00010000:1.0:1783951221.962423:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 24 pid: 17193 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951221.962436:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982656 00000100:00100000:1.0:1783951221.962439:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982656 00010000:00010000:1.0:1783951221.962449:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 25 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951221.962459:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982784 00000100:00100000:1.0:1783951221.962461:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982784 00010000:00010000:1.0:1783951221.962469:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 26 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951221.962477:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944982912 00000100:00100000:1.0:1783951221.962479:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944982912 00010000:00010000:1.0:1783951221.962487:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 27 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951221.962498:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951221.962503:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+27:3654:x1870607944982528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951221.962511:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951221.962516:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 27 pid: 17193 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962525:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 27 pid: 17193 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962546:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951221.962576:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+27:3654:x1870607944982528:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.962582:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951221.962601:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951221.962607:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+26:3654:x1870607944982656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951221.962614:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951221.962620:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 26 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962627:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 26 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962636:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951221.962657:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+26:3654:x1870607944982656:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.962663:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951221.962675:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951221.962680:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+25:3652:x1870607944982784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951221.962687:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951221.962691:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 25 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962698:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 25 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962706:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951221.962730:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+25:3652:x1870607944982784:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.962736:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951221.962747:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951221.962752:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3652:x1870607944982912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951221.962768:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951221.962773:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 24 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962780:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 24 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951221.962790:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951221.962810:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3652:x1870607944982912:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951221.962817:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951221.962858:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944982912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962867:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944982784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962890:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944982656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951221.962897:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944982528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951221.962995:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5d800/0x7645c8e1169f94d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f94c9 expref: 23 pid: 17193 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.963006:0:20224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982016:0@lo:104: 00010000:00010000:2.0:1783951221.963016:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0340030000/0x7645c8e1169f936b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9364 expref: 22 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.963032:0:20224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982144:0@lo:104: 00010000:00010000:2.0:1783951221.963044:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145e00/0x7645c8e1169f932c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9325 expref: 21 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.963053:0:20224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982272:0@lo:104: 00010000:00010000:2.0:1783951221.963061:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608400/0x7645c8e1169f931e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9317 expref: 20 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951221.963069:0:20224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944982400:0@lo:104: 00000100:00100000:3.0:1783951221.977702:0:20224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fbbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944981760:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951221.977718:0:20224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1870607944981888:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951221.977771:0:20224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951221.980329:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951221.980422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951221.981085:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932032 00000100:00100000:3.0:1783951221.981096:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932032 00010000:00010000:3.0:1783951221.981131:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 13 pid: 17192 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951221.981223:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932160 00000100:00100000:3.0:1783951221.981227:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932160 00010000:00010000:3.0:1783951221.981241:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 14 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951221.981266:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1783951221.981277:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+14:2407:x1870607923932032:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951221.981291:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951221.981297:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 14 pid: 17192 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951221.981311:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 14 pid: 17192 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951221.981330:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f9658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa01 expref: 14 pid: 17192 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951221.981345:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951221.981471:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:2.0:1783951221.981493:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2407:x1870607923932160:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951221.981503:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951221.981508:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 13 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981517:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 13 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981528:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67200/0x7645c8e1169f9619 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f991 expref: 13 pid: 17194 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981539:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981548:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981572:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981579:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981586:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981593:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981599:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951221.981604:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981612:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981627:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.981641:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951221.983470:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e90cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:2407:x1870607923932032:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 2185us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951221.983484:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783951221.984836:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:2407:x1870607923932160:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 3350us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951221.984850:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00010000:00010000:2.0:1783951221.984991:0:20224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.985005:0:20224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951221.985029:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948200/0x7645c8e1169f9689 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951222.051400:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951222.113485:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783951222.369680:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944983040:0@lo:400:kworker.0 00000100:00100000:3.0:1783951222.369927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951222.372135:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983040 00000100:00100000:2.0:1783951222.372160:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983040 00000100:00100000:2.0:1783951222.372240:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783951222.372253:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:3654:x1870607944983040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951222.380517:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944983552:0@lo:400:kworker.0 00000100:00100000:3.0:1783951222.380603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951222.380757:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983552 00000100:00100000:0.0:1783951222.380766:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983552 00000100:00100000:0.0:1783951222.380819:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951222.380827:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944983552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951222.380881:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944983552:12345-0@lo:400:kworker.0 Request processed in 55us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951222.380888:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951222.382735:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944983168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951222.382791:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.382818:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944983680:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.382841:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.382863:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944984192:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.382882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.382897:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944984704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.382919:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.382943:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783951222.382962:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944984064:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.382985:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383001:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944984576:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383020:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383067:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944983296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951222.383089:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383105:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944983808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383138:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944984320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383201:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944984832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383221:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383234:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783951222.383239:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944983424:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383257:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383273:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944983936:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383300:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944984448:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.383318:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.383327:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944984960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951222.383345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.386497:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983680 00000100:00100000:1.0:1783951222.386512:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983680 00000100:00100000:1.0:1783951222.386578:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984192 00000100:00100000:1.0:1783951222.386582:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984192 00000100:00100000:1.0:1783951222.387294:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984064 00000100:00100000:1.0:1783951222.387299:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984064 00000100:00100000:1.0:1783951222.387336:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951222.387345:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944983680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951222.387437:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983168 00000100:00100000:0.0:1783951222.387442:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983168 00000100:00100000:0.0:1783951222.387464:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983296 00000100:00100000:0.0:1783951222.387467:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983296 00000100:00100000:0.0:1783951222.387479:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983424 00000100:00100000:0.0:1783951222.387481:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983424 00000100:00100000:0.0:1783951222.387490:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983936 00000100:00100000:0.0:1783951222.387492:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983936 00000100:00100000:0.0:1783951222.387504:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951222.387510:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944983168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951222.387543:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783951222.389457:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:3654:x1870607944983040:12345-0@lo:400:kworker.0 Request processed in 17201us (19523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.389472:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783951222.389537:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944983680:12345-0@lo:400:kworker.0 Request processed in 2191us (6692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951222.389547:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951222.389573:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951222.389585:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944984192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.389663:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984704 00000100:00100000:2.0:1783951222.389670:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984704 00000100:00100000:2.0:1783951222.389702:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984576 00000100:00100000:2.0:1783951222.389706:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984576 00000100:00100000:2.0:1783951222.389720:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944983808 00000100:00100000:2.0:1783951222.389723:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944983808 00000100:00100000:2.0:1783951222.389748:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984320 00000100:00100000:0.0:1783951222.389891:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944983168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2379us (7097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951222.389901:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951222.389921:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951222.389928:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944983296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951222.389955:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783951222.390000:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1870607944983296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951222.390006:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951222.390019:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951222.390024:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944983424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390046:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984320 00000100:00100000:0.0:1783951222.390057:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944983424:12345-0@lo:400:kworker.0 Request processed in 32us (6798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951222.390065:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783951222.390069:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984832 00000100:00100000:2.0:1783951222.390073:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984832 00000100:00100000:0.0:1783951222.390084:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783951222.390093:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944983936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390094:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984448 00000100:00100000:2.0:1783951222.390099:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984448 00000100:00100000:2.0:1783951222.390116:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951222.390125:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944984704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951222.390168:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944983936:12345-0@lo:400:kworker.0 Request processed in 76us (6874us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951222.390175:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951222.390192:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944984704:12345-0@lo:400:kworker.0 Request processed in 68us (7270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.390200:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951222.390204:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951222.390215:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944984064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390220:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951222.390237:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944984576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951222.390259:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944984064:12345-0@lo:400:kworker.0 Request processed in 46us (7272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951222.390266:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951222.390298:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944984576:12345-0@lo:400:kworker.0 Request processed in 64us (7276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.390305:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951222.390322:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951222.390331:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944983808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390360:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607944983808:12345-0@lo:400:kworker.0 Request processed in 32us (7236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.390377:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951222.390388:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951222.390396:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944984320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390421:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607944984320:12345-0@lo:400:kworker.0 Request processed in 27us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.390426:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951222.390436:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951222.390443:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944984832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390467:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607944984832:12345-0@lo:400:kworker.0 Request processed in 26us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.390473:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951222.390484:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951222.390491:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944984448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.390515:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944984448:12345-0@lo:400:kworker.0 Request processed in 26us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.390521:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951222.391861:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944984192:12345-0@lo:400:kworker.0 Request processed in 2272us (8969us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951222.391882:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951222.391958:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944984960 00000100:00100000:1.0:1783951222.391967:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944984960 00000100:00100000:1.0:1783951222.392001:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951222.392009:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944984960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951222.392037:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783951222.392074:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944984960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (8728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951222.392081:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783951222.392097:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951222.392101:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951222.392104:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951222.392106:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951222.393292:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944984064:0@lo:400:kworker.0 00010000:00080000:1.0:1783951222.393325:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248394e00 x1870607944984576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951222.393357:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944984576:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.393397:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944983168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951222.393411:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944983680:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.393425:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944984192:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.393438:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944984704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.393475:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951222.393484:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944985088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951222.393531:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951222.393590:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944983424:0@lo:400:kworker.0 00000100:00100000:2.0:1783951222.393597:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985088 00000100:00100000:2.0:1783951222.393617:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985088 00000100:00100000:2.0:1783951222.393663:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951222.393670:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944985088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951222.393687:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783951222.393727:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944985088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951222.393733:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951222.394428:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944983936:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.394453:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944984448:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.394468:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02479c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944984960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951222.394477:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944983296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951222.394485:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607944983808:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.394492:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607944984320:0@lo:400:kworker.0 00010000:00080000:1.0:1783951222.394501:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0247a28700 x1870607944984832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951222.394507:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0247a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607944984832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951222.394542:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944985088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951222.394847:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944983040:0@lo:400:kworker.0 00000100:00100000:3.0:1783951222.394872:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944983552:0@lo:400:kworker.0 00000100:00100000:2.0:1783951223.051259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951223.051741:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932288 00000100:00100000:3.0:1783951223.051756:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932288 00000100:00100000:3.0:1783951223.051823:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00100000:3.0:1783951223.051898:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:14947:x1870607923932288:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951223.051921:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951223.051944:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343609e00/0x7645c8e1169f9690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa39 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.051981:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343609e00/0x7645c8e1169f9690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa39 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.051993:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343609e00/0x7645c8e1169f9690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa39 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.052005:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609e00, rc 0) 00000100:00100000:3.0:1783951223.052131:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:14947:x1870607923932288:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 298us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951223.052166:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 148 00010000:00010000:1.0:1783951223.072807:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951223.072991:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951223.072996:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0246bc8800 from 13 10000000:01000000:3.0:1783951223.073003:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951223.073062:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.073076:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.073103:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951223.073162:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.073534:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951223.073663:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985216 00000100:00100000:0.0:1783951223.073672:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985216 00000100:00100000:0.0:1783951223.073733:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783951223.073744:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+20:17197:x1870607944985216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951223.073762:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951223.073778:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5de00/0x7645c8e1169f969e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9697 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.073808:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5de00/0x7645c8e1169f969e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9697 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.073820:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5de00/0x7645c8e1169f969e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9697 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.073832:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5de00, rc 0) 00000100:00100000:0.0:1783951223.073935:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944985216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.073944:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783951223.074022:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951223.074050:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951223.074066:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.074077:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951223.074239:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.074636:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951223.074658:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.074717:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985344 00000100:00100000:0.0:1783951223.074730:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985344 00000100:00100000:0.0:1783951223.074766:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783951223.074773:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944985344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.074978:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944985344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.074986:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783951223.075087:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.078013:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.081218:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951223.081297:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951223.081330:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985472 00000100:00100000:3.0:1783951223.081340:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985472 00000100:00100000:3.0:1783951223.081411:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783951223.082303:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944985472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.082744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951223.083031:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944985472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1610us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951223.083050:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783951223.083101:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932416 00000100:00100000:3.0:1783951223.083107:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932416 00000100:00100000:3.0:1783951223.084765:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 152 00000100:00100000:3.0:1783951223.084775:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:14947:x1870607923932416:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.084964:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.087775:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:14947:x1870607923932416:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 2986us (5019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951223.087793:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 152 00000040:00080000:0.0:1783951223.088212:0:20245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783951223.088733:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783951223.088765:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951223.088779:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.088794:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951223.088808:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951223.088811:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0343db7000 from 13 10000000:01000000:3.0:1783951223.088815:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951223.089440:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.089453:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.090215:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951223.090344:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.090447:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951223.091009:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.092065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.095645:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985600 00000100:00100000:1.0:1783951223.095665:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985600 00000100:00100000:0.0:1783951223.095793:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932544 00000100:00100000:0.0:1783951223.095798:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932544 00000100:00100000:0.0:1783951223.095819:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783951223.095830:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:17197:x1870607944985600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951223.095916:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951223.095939:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f96ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f96a5 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.095973:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f96ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f96a5 expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.095986:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f96ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f96a5 expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.095997:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5cc00, rc 0) 00000100:00100000:0.0:1783951223.096134:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944985600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (5685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.096156:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783951223.096343:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 154 00000100:00100000:0.0:1783951223.096352:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:14947:x1870607923932544:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.096696:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:14947:x1870607923932544:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 344us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.096704:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 154 00000100:00100000:2.0:1783951223.097781:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951223.097813:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951223.097827:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951223.097941:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951223.097992:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951223.098123:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246604300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.098404:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985728 00000100:00100000:0.0:1783951223.098410:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985728 00000100:00100000:0.0:1783951223.098647:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951223.098658:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944985728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.098808:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944985728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.098817:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783951223.098933:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951223.098963:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951223.099005:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951223.099326:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246604300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951223.099525:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985856 00000100:00100000:1.0:1783951223.099531:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985856 00000100:00100000:1.0:1783951223.099558:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783951223.099566:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944985856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951223.099762:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944985856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.099770:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783951223.099922:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951223.101296:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783951223.101701:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783951223.101732:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951223.101744:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.101757:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951223.101769:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951223.101772:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e024667e000 from 13 10000000:01000000:1.0:1783951223.101775:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951223.101813:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.101822:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.101895:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951223.101939:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951223.102001:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951223.102046:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.102097:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944985984 00000100:00100000:0.0:1783951223.102105:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944985984 00000100:00100000:0.0:1783951223.102414:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783951223.102529:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+22:17197:x1870607944985984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951223.102543:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951223.102557:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f96ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f96b3 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.102595:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f96ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f96b3 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.102607:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f96ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f96b3 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.102617:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5dc00, rc 0) 00000100:00100000:0.0:1783951223.102676:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944985984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.102683:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783951223.102753:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944985984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951223.102777:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951223.102787:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951223.102875:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951223.102904:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951223.103555:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246604c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951223.103823:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944986112 00000100:00100000:3.0:1783951223.103830:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944986112 00000100:00100000:3.0:1783951223.103927:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783951223.103935:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944986112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.104086:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944986112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951223.104093:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783951223.104693:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951223.104745:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951223.104802:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951223.104920:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944986240 00000100:00100000:3.0:1783951223.104925:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944986240 00000100:00100000:3.0:1783951223.104949:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783951223.104955:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944986240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951223.105036:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944986240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951223.105043:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783951223.105096:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246604c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951223.105186:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951223.114960:0:20247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783951223.116304:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783951223.116351:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951223.116374:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.116389:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951223.116402:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951223.116405:0:17197:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0248309800 from 13 10000000:01000000:1.0:1783951223.116409:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951223.116562:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.116626:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.116640:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951223.116670:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951223.116754:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951223.116808:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.116917:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944986368 00000100:00100000:0.0:1783951223.116928:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944986368 00000100:00100000:0.0:1783951223.116985:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783951223.116996:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0371cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+23:17197:x1870607944986368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951223.117012:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951223.117027:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247b5c200/0x7645c8e1169f96c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f96c1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.117056:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247b5c200/0x7645c8e1169f96c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f96c1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.117067:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247b5c200/0x7645c8e1169f96c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f96c1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951223.117078:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c200, rc 0) 00000100:00100000:0.0:1783951223.117132:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0371cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944986368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.117160:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783951223.117314:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951223.117331:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.117364:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951223.117642:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951223.117670:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951223.117691:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.118325:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944986496 00000100:00100000:0.0:1783951223.118332:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944986496 00000100:00100000:0.0:1783951223.118392:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783951223.118400:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944986496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.118720:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944986496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.118729:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783951223.118786:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.118824:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.118879:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951223.118904:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351cbad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951223.118916:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944986624 00000100:00100000:0.0:1783951223.118920:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944986624 00000100:00100000:0.0:1783951223.118939:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783951223.118946:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944986624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.119020:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:17197:x1870607944986624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.119027:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783951223.119064:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0a9ba1e-8c11-4522-a460-4e640633581c:17197:1870607944986624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951223.121370:0:20248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:3.0:1783951223.122254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951223.122291:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932672 00000100:00100000:3.0:1783951223.122300:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932672 00000100:00100000:3.0:1783951223.122347:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 163 00000100:00100000:3.0:1783951223.122368:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:14947:x1870607923932672:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951223.122387:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951223.122408:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f96cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa40 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.122977:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f96cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa40 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.123005:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f96cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa40 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951223.123017:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608a00, rc 0) 00000100:00100000:3.0:1783951223.123081:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:14947:x1870607923932672:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 726us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951223.123089:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 163 00000020:01000000:1.0:1783951223.123977:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783951223.124021:0:17197:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951223.124035:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951223.124049:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951223.125661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.126339:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932800 00000100:00100000:1.0:1783951223.126350:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932800 00000100:00100000:1.0:1783951223.126635:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 164 00000100:00100000:1.0:1783951223.126648:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:14947:x1870607923932800:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951223.126849:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:14947:x1870607923932800:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 191us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.126859:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 164 00000100:00100000:3.0:1783951223.131948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951223.132045:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923932928 00000100:00100000:0.0:1783951223.132059:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923932928 00000100:00100000:0.0:1783951223.132170:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:0.0:1783951223.132183:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:14947:x1870607923932928:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951223.132373:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:14947:x1870607923932928:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 192us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.132382:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:1.0:1783951223.572894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.572948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.572976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.572998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.573015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.573470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.573491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.573522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951223.573564:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933056 00000100:00100000:1.0:1783951223.573576:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933056 00000100:00100000:1.0:1783951223.573643:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933184 00000100:00100000:1.0:1783951223.573647:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933184 00000100:00100000:1.0:1783951223.573661:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933568 00000100:00100000:1.0:1783951223.573664:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933568 00000100:00100000:1.0:1783951223.573744:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933696 00000100:00100000:1.0:1783951223.573748:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933696 00000100:00100000:1.0:1783951223.573795:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:1.0:1783951223.573807:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2409:x1870607923933056:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951223.573909:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:2409:x1870607923933056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.573917:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:1.0:1783951223.573940:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1783951223.573947:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2409:x1870607923933184:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951223.573981:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2409:x1870607923933184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.573989:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1783951223.574003:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:1.0:1783951223.574009:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+6:2409:x1870607923933568:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951223.574575:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+6:2409:x1870607923933568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.574587:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:1.0:1783951223.574614:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:1.0:1783951223.574622:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923933696:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951223.574652:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923933696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 31us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.574659:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:1.0:1783951223.574815:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933440 00000100:00100000:1.0:1783951223.574820:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933440 00000100:00100000:1.0:1783951223.574844:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933312 00000100:00100000:1.0:1783951223.574847:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933312 00000100:00100000:1.0:1783951223.574860:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933824 00000100:00100000:1.0:1783951223.574863:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933824 00000100:00100000:1.0:1783951223.574873:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923933952 00000100:00100000:1.0:1783951223.574876:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923933952 00000100:00100000:1.0:1783951223.574899:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783951223.574905:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923933440:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951223.574934:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923933440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.574940:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783951223.574952:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:1.0:1783951223.574959:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2409:x1870607923933312:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951223.575061:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783951223.575072:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2409:x1870607923933824:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951223.575102:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2409:x1870607923933824:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 34us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.575128:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783951223.575171:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:0.0:1783951223.575193:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036c58f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923933952:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951223.575228:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036c58f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923933952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 37us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951223.575234:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00080000:0.0:1783951223.575407:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951223.575412:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951223.575415:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951223.575417:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951223.576327:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2409:x1870607923933312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1361us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951223.576337:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00010000:00010000:3.0:1783951224.097919:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951225.120581:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951225.952979:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951225.953011:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944986752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951225.953102:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951225.953227:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944986752 00000100:00100000:1.0:1783951225.953237:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944986752 00000100:00100000:1.0:1783951225.953318:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951225.953361:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944986752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951225.953401:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951225.953458:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944986752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951225.953466:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951225.953534:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944986752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951225.953654:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951226.127625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.127779:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934080 00000100:00100000:3.0:1783951226.127792:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934080 00000100:00100000:3.0:1783951226.127887:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:3.0:1783951226.127900:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+6:15610:x1870607923934080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951226.127928:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.127956:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f96d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa47 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128037:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128054:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128069:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128104:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128112:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128119:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128297:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f96eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128305:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f96eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128312:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f96eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.128360:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951226.128365:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951226.128404:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f96eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128416:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128423:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128430:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128446:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.128451:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128459:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128472:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.128476:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.128480:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.128487:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f96dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951226.129064:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951226.129116:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129126:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129133:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129139:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0382145e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.129481:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129490:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129528:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e024692e400) 00010000:00010000:3.0:1783951226.129531:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.129534:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129539:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f96e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129594:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f96d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa47 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129612:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f96eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa47 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.129621:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e024692eb00) 00010000:00010000:3.0:1783951226.129623:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951226.129625:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382144800, rc 0) 00000100:00100000:3.0:1783951226.129722:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+7:15610:x1870607923934080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1825us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.129732:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:3.0:1783951226.132786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.133012:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934208 00000100:00100000:1.0:1783951226.133024:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934208 00000100:00100000:1.0:1783951226.133097:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1783951226.133110:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e128-5618-477b-951f-a759707c8cef+7:15610:x1870607923934208:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783951226.133297:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e128-5618-477b-951f-a759707c8cef+7:15610:x1870607923934208:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 Request processed in 189us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951226.133306:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:2.0:1783951226.136203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.137061:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934464 00000100:00100000:1.0:1783951226.137076:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934464 00000100:00100000:1.0:1783951226.137560:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:1.0:1783951226.137577:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+7:15610:x1870607923934464:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951226.137605:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951226.137635:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169f96f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa4e expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.137741:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.137759:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.137795:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138091:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138115:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138129:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138315:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2600/0x7645c8e1169f9707 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138325:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2600/0x7645c8e1169f9707 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138372:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2600/0x7645c8e1169f9707 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951226.138384:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783951226.138577:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138585:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138592:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138598:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951226.138622:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138630:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138643:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e024692eb00) 00010000:00010000:1.0:1783951226.138646:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.138651:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138658:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169f96f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138672:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138678:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138684:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138688:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951226.138691:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138697:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138706:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e03438c0100) 00010000:00010000:1.0:1783951226.138709:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.138719:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.138725:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169f9700 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.142102:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169f96f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa4e expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.142178:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2600/0x7645c8e1169f9707 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa4e expref: 9 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.142188:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e03438c0300) 00010000:00010000:1.0:1783951226.142191:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.142194:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2600, rc 0) 00000100:00100000:1.0:1783951226.142272:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+9:15610:x1870607923934464:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 4696us (6125us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783951226.142285:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00010000:00010000:3.0:1783951226.147557:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951226.154566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.157802:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934592 00000100:00100000:1.0:1783951226.157822:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934592 00000100:00100000:1.0:1783951226.157911:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1783951226.157922:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+9:15610:x1870607923934592:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783951226.158063:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+9:15610:x1870607923934592:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 143us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951226.158072:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:3.0:1783951226.160425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.160778:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934720 00000100:00100000:2.0:1783951226.160791:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934720 00000100:00100000:2.0:1783951226.160883:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:2.0:1783951226.160895:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:15610:x1870607923934720:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1783951226.162608:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1783951226.164390:0:19450:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3436us 00000100:00100000:0.0:1783951226.221652:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:15610:x1870607923934720:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 60712us (61193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951226.221672:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:0.0:1783951226.243886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.244009:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934848 00000100:00100000:1.0:1783951226.244022:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934848 00000100:00100000:1.0:1783951226.244134:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:1.0:1783951226.244195:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+9:15616:x1870607923934848:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951226.244233:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951226.244268:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f9715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa55 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244380:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244398:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244410:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244426:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244433:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244440:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244693:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244702:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244709:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244727:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951226.244732:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244740:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244754:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:1.0:1783951226.244757:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.244762:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244769:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f971c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244786:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244793:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244800:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244805:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951226.244807:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244814:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244834:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e03438c0100) 00010000:00010000:1.0:1783951226.244837:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.244840:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244846:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2400/0x7645c8e1169f9723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244898:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f9715 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa55 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244909:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:1.0:1783951226.244911:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.244914:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f9715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa55 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.244924:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2c00, rc 0) 00000100:00100000:1.0:1783951226.245202:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+9:15616:x1870607923934848:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1008us (2069us total) trans 0 rc 301/301 00000100:00100000:1.0:1783951226.245220:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:2.0:1783951226.258866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.258993:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923934976 00000100:00100000:3.0:1783951226.259006:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923934976 00000100:00100000:3.0:1783951226.259094:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1783951226.259106:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e04e128-5618-477b-951f-a759707c8cef+9:15616:x1870607923934976:12345-192.168.202.33@tcp:700:lfs.0 00000100:00100000:3.0:1783951226.259252:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e04e128-5618-477b-951f-a759707c8cef+9:15616:x1870607923934976:12345-192.168.202.33@tcp:700:lfs.0 Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.259461:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1783951226.262595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.262874:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923935232 00000100:00100000:1.0:1783951226.262888:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923935232 00000100:00100000:1.0:1783951226.262965:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:1.0:1783951226.262977:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+9:15616:x1870607923935232:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:1.0:1783951226.263058:0:17200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951226.263102:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948a00/0x7645c8e1169f9643 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9c2 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.263168:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:1.0:1783951226.263184:0:17200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951226.263291:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.263308:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 5 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.263320:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.263487:0:17200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 5 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.263573:0:17200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 5 pid: 19450 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951226.263592:0:17200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17200:1870607944986880:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951226.263760:0:17200:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951226.270271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.270376:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923935360 00000100:00100000:2.0:1783951226.270388:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923935360 00010000:00010000:2.0:1783951226.270459:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 6 pid: 19450 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951226.270540:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1783951226.270550:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2407:x1870607923935360:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951226.270570:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951226.270578:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 6 pid: 19450 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.270592:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 6 pid: 19450 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.270618:0:18355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:2.0:1783951226.270624:0:18355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.270635:0:18355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.270643:0:18355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.270665:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951226.270734:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2407:x1870607923935360:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 184us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951226.270743:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00080000:0.0:1783951226.271054:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783951226.275579:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f9682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa32 expref: 5 pid: 19450 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951226.275614:0:17200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17200:1870607944986880:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951226.275645:0:17200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.275741:0:17200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.275750:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.275801:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.275816:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.275827:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280072:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280169:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280185:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951226.280224:0:17200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020658620 reply state 00000000ff81f666 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280236:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280244:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:2.0:1783951226.280247:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951226.280252:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951226.280257:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783951226.280266:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280273:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280292:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280298:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951226.280303:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280311:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280321:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:2.0:1783951226.280323:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951226.280384:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280453:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2c00/0x7645c8e1169f972a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951226.280478:0:17200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020658620 reply state 00000000ff81f666 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280487:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.280493:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e0247826400) 00010000:00010000:2.0:1783951226.280495:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951226.280498:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783951226.280609:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+10:15616:x1870607923935232:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 17629us (18024us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783951226.280620:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:0.0:1783951226.376793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.376958:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923935488 00000100:00100000:2.0:1783951226.376967:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923935488 00000100:00100000:2.0:1783951226.377061:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:2.0:1783951226.377072:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+10:15624:x1870607923935488:12345-192.168.202.33@tcp:101:lctl.0 00010000:00010000:2.0:1783951226.377105:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951226.377129:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f973f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa5c expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.377234:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948600/0x7645c8e1169f9746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.377250:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948600/0x7645c8e1169f9746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.377264:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948600/0x7645c8e1169f9746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951226.377313:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951226.377317:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951226.377363:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948600/0x7645c8e1169f9746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.377387:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f973f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa5c expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.377417:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948600/0x7645c8e1169f9746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa5c expref: 11 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.377426:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:2.0:1783951226.377429:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951226.377445:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948600, rc 0) 00000100:00100000:2.0:1783951226.377505:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+11:15624:x1870607923935488:12345-192.168.202.33@tcp:101:lctl.0 Request processed in 435us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951226.377512:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:2.0:1783951226.399918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951226.400044:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923935616 00000100:00100000:0.0:1783951226.400057:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923935616 00000100:00100000:0.0:1783951226.400188:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:0.0:1783951226.400201:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:15625:x1870607923935616:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951226.400230:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.400948:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f974d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa63 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.401036:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145c00/0x7645c8e1169f9754 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.401052:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145c00/0x7645c8e1169f9754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.401066:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145c00/0x7645c8e1169f9754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.401227:0:19450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951226.401232:0:19450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951226.404453:0:19450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145c00/0x7645c8e1169f9754 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.404529:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145e00/0x7645c8e1169f974d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa63 expref: 7 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.404565:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145c00/0x7645c8e1169f9754 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa63 expref: 6 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.404576:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.404605:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951226.404610:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0382145c00, rc 0) 00000100:00100000:3.0:1783951226.404791:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:15625:x1870607923935616:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 4590us (4885us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.404803:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951226.413404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.413773:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923935744 00000100:00100000:3.0:1783951226.413786:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923935744 00000100:00100000:3.0:1783951226.413884:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:3.0:1783951226.413897:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+6:15625:x1870607923935744:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951226.413932:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.413964:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f975b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa6a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414058:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414087:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414102:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414115:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414122:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414128:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414307:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9a00/0x7645c8e1169f9770 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.414316:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9a00/0x7645c8e1169f9770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415071:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9a00/0x7645c8e1169f9770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.415217:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951226.415222:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951226.415248:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9a00/0x7645c8e1169f9770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415264:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415271:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415279:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415287:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.415291:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415300:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415315:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.415526:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.415534:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415541:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169f9762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415563:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415570:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415576:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415582:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.415585:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415592:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415601:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e0247826400) 00010000:00010000:3.0:1783951226.415604:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.415607:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415612:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609200/0x7645c8e1169f9769 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415653:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144000/0x7645c8e1169f975b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa6a expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415684:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9a00/0x7645c8e1169f9770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa6a expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.415692:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:3.0:1783951226.415695:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951226.415697:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9a00, rc 0) 00000100:00100000:3.0:1783951226.415961:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+7:15625:x1870607923935744:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 2065us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.415973:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:2.0:1783951226.419711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.419904:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923935872 00000100:00100000:1.0:1783951226.419933:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923935872 00000100:00100000:1.0:1783951226.420027:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:1.0:1783951226.420039:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a956fd71-c100-46a9-957b-d126f21246ff+5:15625:x1870607923935872:12345-192.168.202.33@tcp:900:lfs.0 00000100:00100000:1.0:1783951226.420196:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a956fd71-c100-46a9-957b-d126f21246ff+5:15625:x1870607923935872:12345-192.168.202.33@tcp:900:lfs.0 Request processed in 158us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951226.420205:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00080000:3.0:1783951226.422573:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951226.424491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.424641:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923936128 00000100:00100000:3.0:1783951226.424654:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923936128 00000100:00100000:3.0:1783951226.424734:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:3.0:1783951226.424746:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+7:15625:x1870607923936128:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951226.424832:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.424862:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa71 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.425006:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783951226.426117:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9777 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa71 expref: 9 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.426139:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.426168:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951226.426183:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa71 expref: 9 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.426225:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8000, rc 0) 00000100:00100000:3.0:1783951226.426314:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+8:15625:x1870607923936128:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1569us (1837us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1783951226.426324:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1783951226.429542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.429736:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923936384 00000100:00100000:2.0:1783951226.429749:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923936384 00000100:00100000:2.0:1783951226.429831:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:2.0:1783951226.429843:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+8:15625:x1870607923936384:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:2.0:1783951226.429922:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951226.429956:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9a00/0x7645c8e1169f9770 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa6a expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.429982:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:2.0:1783951226.429987:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951226.430017:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.430032:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.430043:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951226.430595:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003317a6d0 reply state 00000000bbd4d504 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.430638:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.430646:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:2.0:1783951226.430649:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783951226.430652:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951226.430665:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783951226.430917:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+9:15625:x1870607923936384:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 1073us (1388us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783951226.430927:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:2.0:1783951226.440952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951226.441074:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923936640 00000100:00100000:0.0:1783951226.441307:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923936640 00000100:00100000:2.0:1783951226.441588:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:2.0:1783951226.441604:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956fd71-c100-46a9-957b-d126f21246ff+9:15625:x1870607923936640:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951226.441935:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956fd71-c100-46a9-957b-d126f21246ff+10:15625:x1870607923936640:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 333us (1179us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783951226.441945:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:1.0:1783951226.445125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.445474:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923936896 00000100:00100000:3.0:1783951226.445486:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923936896 00000100:00100000:3.0:1783951226.445563:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:3.0:1783951226.445577:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+10:15625:x1870607923936896:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951226.445609:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.445636:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f978c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa78 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.445729:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.445747:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.445890:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.445906:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.445914:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.445922:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.446101:0:19450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783951226.446405:0:19450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446415:0:19450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446422:0:19450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446429:0:19450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.446434:0:19450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446442:0:19450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446456:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.446459:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.446465:0:19450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446472:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f9793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446490:0:19450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446496:0:19450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446514:0:19450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446520:0:19450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.446523:0:19450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446529:0:19450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446537:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e0247826400) 00010000:00010000:3.0:1783951226.446539:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.446542:0:19450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446548:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f979a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446589:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f978c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa78 expref: 12 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446601:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.446603:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951226.446607:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f978c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa78 expref: 12 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.446618:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8000, rc 0) 00000100:00100000:3.0:1783951226.446753:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+11:15625:x1870607923936896:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1178us (1641us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1783951226.446780:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:1.0:1783951226.457989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.459443:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923937024 00000100:00100000:3.0:1783951226.459466:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923937024 00000100:00100000:3.0:1783951226.459615:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:3.0:1783951226.459629:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+11:15625:x1870607923937024:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951226.459665:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.459695:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f97a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa7f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.459830:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.459849:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.459864:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.459902:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951226.459907:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951226.459932:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.459962:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f97a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.459987:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.460017:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:3.0:1783951226.460020:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951226.460024:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8e00, rc 0) 00000100:00100000:3.0:1783951226.461130:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+12:15625:x1870607923937024:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1495us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.461162:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:0.0:1783951226.466534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.466738:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923937152 00000100:00100000:3.0:1783951226.466751:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923937152 00000100:00100000:3.0:1783951226.466833:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:3.0:1783951226.466847:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a956fd71-c100-46a9-957b-d126f21246ff+12:15625:x1870607923937152:12345-192.168.202.33@tcp:37:lfs.0 00000100:00100000:1.0:1783951226.474927:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a956fd71-c100-46a9-957b-d126f21246ff+12:15625:x1870607923937152:12345-192.168.202.33@tcp:37:lfs.0 Request processed in 8064us (8385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951226.474955:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1783951226.478978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.479435:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923937408 00000100:00100000:2.0:1783951226.479449:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923937408 00000100:00100000:2.0:1783951226.479519:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783951226.479533:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e518c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956fd71-c100-46a9-957b-d126f21246ff+12:15625:x1870607923937408:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951226.480010:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e518c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a956fd71-c100-46a9-957b-d126f21246ff+13:15625:x1870607923937408:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 478us (1046us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783951226.480021:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000040:00080000:2.0:1783951226.529422:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783951226.558364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.558465:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923937536 00000100:00100000:3.0:1783951226.558477:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923937536 00000100:00100000:3.0:1783951226.558560:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:3.0:1783951226.558573:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+11:15631:x1870607923937536:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951226.558605:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.558632:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f97b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa86 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.558728:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.558745:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.558930:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.558969:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.558979:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.558986:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559090:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f97cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559100:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f97cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559108:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f97cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.559201:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951226.559205:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951226.559254:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f97cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559270:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559278:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559285:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559303:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.559308:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559316:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559340:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.559343:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.559350:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559357:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f97bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559375:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559381:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559388:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559393:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951226.559396:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559404:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559425:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e0247826400) 00010000:00010000:3.0:1783951226.559428:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951226.559430:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559436:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559472:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f97b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa86 expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559487:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f97cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa86 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.559495:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:3.0:1783951226.559497:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783951226.559500:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8800, rc 0) 00000100:00100000:3.0:1783951226.559590:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+12:15631:x1870607923937536:12345-192.168.202.33@tcp:101:bash.0 Request processed in 1019us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.559600:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:1.0:1783951226.571274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.571915:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923937664 00000100:00100000:3.0:1783951226.571928:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923937664 00000100:00100000:3.0:1783951226.571996:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951226.572007:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e128-5618-477b-951f-a759707c8cef+5:15631:x1870607923937664:12345-192.168.202.33@tcp:900:bash.0 00000100:00100000:3.0:1783951226.572135:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e128-5618-477b-951f-a759707c8cef+5:15631:x1870607923937664:12345-192.168.202.33@tcp:900:bash.0 Request processed in 129us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.572162:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:1.0:1783951226.576790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.576870:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923937920 00000100:00100000:2.0:1783951226.576900:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923937920 00000100:00100000:2.0:1783951226.576980:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:2.0:1783951226.576994:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+12:15631:x1870607923937920:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951226.577047:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951226.577077:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f97d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa8d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.577266:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.577285:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.577296:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.577355:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.577371:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 12 pid: 17201 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951226.577386:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381149180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870607944987008:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951226.577490:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951226.584930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.585125:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923938048 00000100:00100000:3.0:1783951226.585139:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923938048 00010000:00010000:3.0:1783951226.585239:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 13 pid: 17201 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951226.585305:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:3.0:1783951226.585317:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a956fd71-c100-46a9-957b-d126f21246ff+13:2407:x1870607923938048:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951226.585347:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951226.585356:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 13 pid: 17201 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.585373:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 13 pid: 17201 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.585411:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:3.0:1783951226.585418:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.585430:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.585439:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.585467:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951226.585943:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a956fd71-c100-46a9-957b-d126f21246ff+13:2407:x1870607923938048:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 624us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.585955:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00010000:00010000:1.0:1783951226.586941:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8e00/0x7645c8e1169f97af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa7f expref: 12 pid: 17201 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951226.586969:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381149180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870607944987008:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951226.586999:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.587010:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.587016:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.587068:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.587093:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.587104:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590189:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590232:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590254:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951226.590272:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783951226.590316:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590335:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590343:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590349:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951226.590354:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590381:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590406:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:1.0:1783951226.590409:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951226.590415:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590421:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949400/0x7645c8e1169f97d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951226.590442:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d21df76b reply state 0000000039778810 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590454:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590460:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e03438c0100) 00010000:00010000:1.0:1783951226.590462:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951226.590465:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783951226.590523:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949600/0x7645c8e1169f97d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590541:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 14 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.590550:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951226.590551:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783951226.590554:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c3c00, rc 0) 00000100:00100000:1.0:1783951226.590665:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+15:15631:x1870607923937920:12345-192.168.202.33@tcp:101:bash.0 Request processed in 13673us (13888us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783951226.590675:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:2.0:1783951226.607997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.611951:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923938176 00000100:00100000:3.0:1783951226.612001:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923938176 00000100:00100000:3.0:1783951226.612118:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:3.0:1783951226.612130:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+15:15631:x1870607923938176:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1783951226.612235:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.612279:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f97f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa94 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612400:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612419:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612435:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.612528:0:19450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783951226.612533:0:19450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951226.612557:0:19450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612569:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612602:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f97f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 17 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612628:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 16 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.612638:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951226.612649:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951226.612654:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9400, rc 0) 00000100:00100000:3.0:1783951226.612741:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+16:15631:x1870607923938176:12345-192.168.202.33@tcp:101:bash.0 Request processed in 612us (4762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951226.612749:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:2.0:1783951226.629480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.629954:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923938432 00000100:00100000:1.0:1783951226.629967:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923938432 00000100:00100000:1.0:1783951226.630056:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1783951226.630069:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e128-5618-477b-951f-a759707c8cef+16:15631:x1870607923938432:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:1.0:1783951226.631250:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e128-5618-477b-951f-a759707c8cef+17:15631:x1870607923938432:12345-192.168.202.33@tcp:35:bash.0 Request processed in 1174us (1778us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783951226.631273:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1783951226.805591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.805954:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923938688 00000100:00100000:3.0:1783951226.805969:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923938688 00000100:00100000:3.0:1783951226.806047:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:3.0:1783951226.806059:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+17:15642:x1870607923938688:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951226.806098:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.806123:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fa9b expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.806558:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783951226.806708:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9803 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa9b expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.806726:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:3.0:1783951226.806729:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951226.806847:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa9b expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.806865:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9200, rc 0) 00000100:00100000:3.0:1783951226.806947:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+18:15642:x1870607923938688:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 891us (1373us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1783951226.806956:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:0.0:1783951226.815294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.815693:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923938944 00000100:00100000:2.0:1783951226.815721:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923938944 00000100:00100000:2.0:1783951226.815806:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1783951226.815820:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+18:15642:x1870607923938944:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951226.816184:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+19:15642:x1870607923938944:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 366us (902us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783951226.816193:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1783951226.895753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951226.895866:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923939200 00000100:00100000:3.0:1783951226.895898:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923939200 00000100:00100000:3.0:1783951226.895977:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:3.0:1783951226.895990:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+19:15645:x1870607923939200:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951226.896024:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951226.896053:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9811 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3faa2 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.896593:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9818 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.896614:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.896630:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951226.896644:0:19450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783951226.896792:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9811 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faa2 expref: 22 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.896818:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9818 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faa2 expref: 21 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951226.896828:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951226.896832:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951226.896837:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8000, rc 0) 00000100:00100000:3.0:1783951226.896925:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+21:15645:x1870607923939200:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 937us (1186us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783951226.896934:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:0.0:1783951226.904087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951226.904138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951226.904302:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923939456 00000100:00100000:1.0:1783951226.904317:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923939456 00000100:00100000:1.0:1783951226.904405:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:1.0:1783951226.904419:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+21:15645:x1870607923939456:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:1.0:1783951226.904515:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904538:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904553:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904611:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904620:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904649:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904655:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951226.904661:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904670:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904685:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951226.904689:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951226.904694:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951226.904702:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2a00/0x7645c8e1169f9826 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951226.904816:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+21:15645:x1870607923939456:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 399us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951226.904825:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:2.0:1783951226.905744:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923939328 00000100:00100000:2.0:1783951226.905756:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923939328 00000100:00100000:2.0:1783951226.906035:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:2.0:1783951226.906045:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+21:2409:x1870607923939328:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951226.906062:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951226.906088:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9818 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faa2 expref: 21 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951226.906108:0:18355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:2.0:1783951226.906114:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951226.906203:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+20:2409:x1870607923939328:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 159us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951226.906212:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1783951226.916590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951226.924587:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923939712 00000100:00100000:2.0:1783951226.924611:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923939712 00000100:00100000:2.0:1783951226.924716:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951226.924730:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+20:15645:x1870607923939712:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951226.925060:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+21:15645:x1870607923939712:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 333us (8484us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783951226.925090:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951226.985055:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944987136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951226.985219:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951226.986188:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987136 00000100:00100000:1.0:1783951226.986210:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987136 00000100:00100000:1.0:1783951226.986347:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951226.986360:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944987136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951226.986393:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951226.986469:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944987136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951226.986478:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951226.986562:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944987136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783951226.986696:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951227.172779:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951227.240639:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951227.408400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.408601:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923939968 00000100:00100000:3.0:1783951227.408614:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923939968 00000100:00100000:3.0:1783951227.408693:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:3.0:1783951227.408706:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+21:15676:x1870607923939968:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:3.0:1783951227.408740:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951227.408767:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f982d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3faa9 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.408918:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f9834 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.408936:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f9834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.408952:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f9834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951227.408966:0:19450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783951227.409207:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f982d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faa9 expref: 24 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.409232:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f9834 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faa9 expref: 23 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.409242:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.409246:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951227.409251:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9000, rc 0) 00000100:00100000:3.0:1783951227.409354:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+23:15676:x1870607923939968:12345-192.168.202.33@tcp:101:cat.0 Request processed in 643us (969us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783951227.409373:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:0.0:1783951227.417808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.417909:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923940224 00000100:00100000:2.0:1783951227.417923:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923940224 00000100:00100000:2.0:1783951227.417996:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:2.0:1783951227.418008:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+23:15676:x1870607923940224:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:2.0:1783951227.418589:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+24:15676:x1870607923940224:12345-192.168.202.33@tcp:35:cat.0 Request processed in 580us (794us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1783951227.418598:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:1.0:1783951227.431726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.439756:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923940352 00000100:00100000:3.0:1783951227.439779:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923940352 00000100:00100000:2.0:1783951227.440127:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:2.0:1783951227.440186:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e04e128-5618-477b-951f-a759707c8cef+24:2408:x1870607923940352:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951227.440209:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951227.440250:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f9834 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faa9 expref: 24 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.440285:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:2.0:1783951227.440291:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951227.440847:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e04e128-5618-477b-951f-a759707c8cef+23:2408:x1870607923940352:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 706us (9133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.440856:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:1.0:1783951227.490595:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944987392:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.490695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.490736:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944987904:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.490762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.490781:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944988416:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.490807:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.490834:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783951227.490840:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944987520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.490866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.490881:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944988032:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.490901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.490914:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944988544:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.490934:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.490974:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987392 00000100:00100000:1.0:1783951227.490983:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987392 00000100:00100000:1.0:1783951227.491035:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987904 00000100:00100000:1.0:1783951227.491038:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987904 00000100:00100000:1.0:1783951227.491057:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951227.491067:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944987392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.491130:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944987392:12345-0@lo:400:kworker.0 Request processed in 64us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.491138:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951227.491200:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951227.491207:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944987904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.491239:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944987904:12345-0@lo:400:kworker.0 Request processed in 33us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.491245:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951227.491592:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944987264:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.491630:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491662:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944987776:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.491687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491710:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944988288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.491733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491749:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944988800:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.491770:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491785:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783951227.491791:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944987648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.491800:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951227.491809:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944988928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951227.491813:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491827:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944988160:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.491843:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491845:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.491862:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944988672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.491882:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988928 00000100:00100000:1.0:1783951227.491882:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951227.491887:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988928 00000100:00100000:1.0:1783951227.491904:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987264 00000100:00100000:1.0:1783951227.491907:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987264 00000100:00100000:2.0:1783951227.491928:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951227.491928:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783951227.491934:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944988928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951227.491934:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3653:x1870607944987264:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1783951227.491965:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783951227.491970:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3653:x1870607944987264:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.491984:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783951227.491997:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944988928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492003:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951227.492017:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987520 00000100:00100000:1.0:1783951227.492020:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987520 00000100:00100000:1.0:1783951227.492038:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988032 00000100:00100000:1.0:1783951227.492041:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988032 00000100:00100000:2.0:1783951227.492052:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944988928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951227.492053:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987648 00000100:00100000:1.0:1783951227.492055:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987648 00000100:00100000:1.0:1783951227.492065:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988160 00000100:00100000:1.0:1783951227.492067:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988160 00000100:00100000:1.0:1783951227.492080:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951227.492085:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944987520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492109:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988416 00000100:00100000:2.0:1783951227.492113:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988416 00000100:00100000:1.0:1783951227.492116:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944987520:12345-0@lo:400:kworker.0 Request processed in 31us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.492122:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951227.492131:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988544 00000100:00100000:1.0:1783951227.492132:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951227.492134:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988544 00000100:00100000:1.0:1783951227.492138:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492176:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944987776 00000100:00100000:2.0:1783951227.492180:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944987776 00000100:00100000:2.0:1783951227.492192:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988288 00000100:00100000:1.0:1783951227.492199:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944988032:12345-0@lo:400:kworker.0 Request processed in 61us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492205:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988288 00000100:00100000:1.0:1783951227.492205:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951227.492216:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951227.492218:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988800 00000100:00100000:2.0:1783951227.492220:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988800 00000100:00100000:1.0:1783951227.492222:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944987648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492261:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944988672 00000100:00100000:2.0:1783951227.492265:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944988672 00000100:00100000:2.0:1783951227.492282:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951227.492289:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492331:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607944988416:12345-0@lo:400:kworker.0 Request processed in 42us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492338:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951227.492360:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951227.492366:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492404:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607944988544:12345-0@lo:400:kworker.0 Request processed in 39us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492418:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951227.492430:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951227.492435:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944987776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492464:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944987776:12345-0@lo:400:kworker.0 Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492470:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951227.492823:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783951227.492834:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944988288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492871:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944988288:12345-0@lo:400:kworker.0 Request processed in 40us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492877:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783951227.492891:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783951227.492897:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02479c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492923:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02479c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944988800:12345-0@lo:400:kworker.0 Request processed in 26us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492928:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783951227.492939:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951227.492945:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944988672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.492971:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1870607944988672:12345-0@lo:400:kworker.0 Request processed in 26us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.492977:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951227.493036:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944987520:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493048:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944988032:0@lo:400:kworker.0 00010000:00080000:2.0:1783951227.493062:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024860f800 x1870607944988544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951227.493082:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607944988544:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493099:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944987392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493112:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944987904:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493123:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607944988416:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493215:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1870607944988672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493226:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944987264:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.493237:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944987776:0@lo:400:kworker.0 00000100:00100000:0.0:1783951227.493468:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951227.493480:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944988160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951227.493532:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944988160:12345-0@lo:400:kworker.0 Request processed in 56us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.493539:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1783951227.493569:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951227.493573:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951227.493576:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951227.493578:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951227.493596:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944989056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951227.493631:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951227.493665:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944989184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951227.493693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951227.493712:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951227.493718:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944989312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951227.493743:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944989056 00000100:00100000:3.0:1783951227.493749:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944989056 00000100:00100000:3.0:1783951227.493782:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951227.493790:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944989056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951227.493805:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783951227.493844:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944989056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.493850:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951227.493958:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951227.494005:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944989184 00000100:00100000:3.0:1783951227.494010:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944989184 00000100:00100000:0.0:1783951227.494010:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944989056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951227.494031:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944989312 00000100:00100000:3.0:1783951227.494034:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944989312 00000100:00100000:0.0:1783951227.494039:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783951227.494046:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944989184:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951227.494047:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783951227.494052:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944989312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951227.494074:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000004:00000024:0.0:1783951227.494074:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783951227.494114:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944989312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.494120:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951227.494300:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944988288:0@lo:400:kworker.0 00010000:00080000:2.0:1783951227.494331:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024860ea00 x1870607944988800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951227.494342:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944988800:0@lo:400:kworker.0 00000100:00100000:1.0:1783951227.494538:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944987648:12345-0@lo:400:kworker.0 Request processed in 2313us (2721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.494547:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951227.494574:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944987648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951227.494584:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944988160:0@lo:400:kworker.0 00000100:00100000:3.0:1783951227.497371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.498031:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923940608 00000100:00100000:2.0:1783951227.498044:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923940608 00000100:00100000:2.0:1783951227.498124:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:2.0:1783951227.498135:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+23:15682:x1870607923940608:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:2.0:1783951227.498212:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951227.498249:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9842 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fab0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498484:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498504:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498512:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 24 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498522:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498568:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 24 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498583:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 24 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.498599:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381148000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870607944989440:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951227.498724:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.498734:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.498743:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038114aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870607944989568:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951227.498779:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951227.502403:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944989184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8332us (8683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.502423:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951227.503479:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944989312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951227.503521:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944989184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951227.505903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.506032:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923940736 00000100:00100000:3.0:1783951227.506044:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923940736 00010000:00010000:3.0:1783951227.506095:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 25 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.506195:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:3.0:1783951227.506224:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+25:2408:x1870607923940736:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951227.506247:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951227.506257:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 25 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.506272:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 25 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.506299:0:18355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.506306:0:18355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.506329:0:18355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.506337:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951227.506508:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+25:2408:x1870607923940736:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 286us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.506517:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00010000:00010000:2.0:1783951227.506636:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f97fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa94 expref: 24 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.506659:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381148000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870607944989440:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951227.506672:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038114aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870607944989568:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951227.506699:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.511079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.511204:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923940864 00000100:00100000:0.0:1783951227.511215:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923940864 00010000:00010000:0.0:1783951227.511573:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951227.511627:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951227.511640:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbc2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e04e128-5618-477b-951f-a759707c8cef+24:2410:x1870607923940864:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951227.511660:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951227.511668:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.511683:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.511710:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3c00/0x7645c8e1169f97e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa8d expref: 24 pid: 17199 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.511733:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:0.0:1783951227.511739:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.511768:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.511776:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.511906:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951227.511981:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbc2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e04e128-5618-477b-951f-a759707c8cef+23:2410:x1870607923940864:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 343us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.511990:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00010000:00010000:2.0:1783951227.514571:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.514593:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951227.514626:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783951227.514867:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9842 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab0 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.514890:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab0 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.514901:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:2.0:1783951227.514905:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951227.514909:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949200, rc 0) 00000100:00100000:2.0:1783951227.515006:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+23:15682:x1870607923940608:12345-192.168.202.33@tcp:101:dd.0 Request processed in 16871us (17654us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783951227.515036:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:2.0:1783951227.519807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.519899:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923940992 00000100:00100000:3.0:1783951227.519912:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923940992 00000100:00100000:3.0:1783951227.519980:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:3.0:1783951227.519994:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+23:15682:x1870607923940992:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:3.0:1783951227.520030:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951227.520067:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9857 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fab7 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.520115:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.520195:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.520210:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.520569:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f9857 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 25 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.520595:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 24 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.520605:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.520608:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951227.520614:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8200, rc 0) 00000100:00100000:3.0:1783951227.520694:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+24:15682:x1870607923940992:12345-192.168.202.33@tcp:101:dd.0 Request processed in 703us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.520704:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:1.0:1783951227.528510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.528625:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923941248 00000100:00100000:3.0:1783951227.528638:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923941248 00000100:00100000:3.0:1783951227.528764:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:3.0:1783951227.528777:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+24:15682:x1870607923941248:12345-192.168.202.33@tcp:36:dd.0 00010000:00010000:3.0:1783951227.529111:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.529133:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.529197:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951227.529266:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1783951227.529295:0:17201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000764fc4e3 reply state 00000000b1ad1c1b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.529311:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.529331:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.529333:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951227.529338:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951227.529577:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+27:15682:x1870607923941248:12345-192.168.202.33@tcp:36:dd.0 Request processed in 800us (1078us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1783951227.529587:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000020:00080000:3.0:1783951227.529592:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783951227.532537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.532644:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923941376 00000100:00100000:3.0:1783951227.532656:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923941376 00000100:00100000:3.0:1783951227.532765:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:3.0:1783951227.532778:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+27:15682:x1870607923941376:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:3.0:1783951227.532808:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951227.532833:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f986c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fabe expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.532909:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f986c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fabe expref: 28 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.532927:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f986c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fabe expref: 28 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.532971:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.532975:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951227.532979:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8400, rc 0) 00000100:00100000:3.0:1783951227.533052:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+28:15682:x1870607923941376:12345-192.168.202.33@tcp:101:dd.0 Request processed in 277us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.533060:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:1.0:1783951227.544893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.545099:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923941632 00000100:00100000:3.0:1783951227.545111:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923941632 00000100:00100000:3.0:1783951227.545309:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:3.0:1783951227.545336:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+28:15682:x1870607923941632:12345-192.168.202.33@tcp:103:dd.0 00010000:00010000:3.0:1783951227.545357:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951227.545502:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f986c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fabe expref: 28 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.545529:0:18355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.545536:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951227.545658:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+27:15682:x1870607923941632:12345-192.168.202.33@tcp:103:dd.0 Request processed in 326us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.545667:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:1.0:1783951227.548717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.548834:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923941760 00000100:00100000:2.0:1783951227.548845:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923941760 00000100:00100000:2.0:1783951227.548947:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:2.0:1783951227.548959:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+27:15682:x1870607923941760:12345-192.168.202.33@tcp:58:dd.0 00010000:00010000:2.0:1783951227.549104:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.549127:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.549173:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951227.550848:0:17199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951227.551083:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783951227.551745:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783951227.554664:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+27:15682:x1870607923941760:12345-192.168.202.33@tcp:58:dd.0 Request processed in 5687us (5940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.554685:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000040:00080000:3.0:1783951227.554906:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783951227.554912:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951227.554944:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783951227.554953:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783951227.555121:0:17234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17234:1870607944989696:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783951227.555588:0:17234:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7d240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951227.561552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.561678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.561763:0:17234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17234:1870607944989696:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951227.562045:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923941888 00000100:00100000:0.0:1783951227.562055:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923941888 00000100:00100000:0.0:1783951227.562122:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923942016 00000100:00100000:0.0:1783951227.562126:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923942016 00000100:00100000:0.0:1783951227.562179:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:0.0:1783951227.562189:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+28:15682:x1870607923941888:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:0.0:1783951227.562215:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951227.562255:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fac5 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.562342:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.562355:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 29 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.562495:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:2.0:1783951227.562505:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+29:15684:x1870607923942016:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951227.562533:0:17199:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951227.562760:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+29:15684:x1870607923942016:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 256us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.562785:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 49 00010000:00010000:0.0:1783951227.563262:0:17200:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.563294:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.563455:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:0.0:1783951227.563459:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951227.563465:0:17200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.563474:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c600, rc 0) 00000100:00100000:0.0:1783951227.563563:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+28:15682:x1870607923941888:12345-192.168.202.33@tcp:101:dd.0 Request processed in 1374us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.563572:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:0.0:1783951227.569872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.570539:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923942144 00000100:00100000:2.0:1783951227.570553:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923942144 00000100:00100000:2.0:1783951227.570631:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:2.0:1783951227.570644:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+28:15684:x1870607923942144:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783951227.570744:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.570764:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.570779:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.570955:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.570979:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571061:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571093:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571103:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571110:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951227.571609:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783951227.571615:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951227.571914:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571930:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571937:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571945:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571951:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951227.571956:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571964:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.571986:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e03438c0300) 00010000:00010000:2.0:1783951227.572175:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951227.572188:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572195:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f9881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572212:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572230:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572237:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572242:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951227.572245:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572251:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572259:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e0247826b00) 00010000:00010000:2.0:1783951227.572262:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951227.572264:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572270:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f9888 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572284:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572290:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572296:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572300:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951227.572307:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572313:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572331:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:2.0:1783951227.572334:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951227.572337:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.572343:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948c00/0x7645c8e1169f988f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.572514:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+28:15684:x1870607923942144:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 1869us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.572527:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:2.0:1783951227.575292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.575600:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923942400 00000100:00100000:0.0:1783951227.575609:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923942400 00000100:00100000:0.0:1783951227.575897:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:0.0:1783951227.575910:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+28:15684:x1870607923942400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951227.575931:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951227.575952:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9896 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3facc expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576192:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576207:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576235:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951227.576247:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783951227.576336:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576344:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576351:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576357:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951227.576361:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576369:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576380:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:0.0:1783951227.576383:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951227.576387:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576393:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5d800/0x7645c8e1169f989d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576543:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9896 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3facc expref: 30 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576564:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e03438c0300) 00010000:00010000:0.0:1783951227.576566:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951227.576571:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c800/0x7645c8e1169f9896 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3facc expref: 30 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.576580:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247b5c800, rc 0) 00000100:00100000:0.0:1783951227.576797:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+29:15684:x1870607923942400:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 791us (1413us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1783951227.576806:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:3.0:1783951227.579816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.586557:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923942528 00000100:00100000:2.0:1783951227.586571:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923942528 00000100:00100000:2.0:1783951227.586870:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:2.0:1783951227.586882:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+29:15684:x1870607923942528:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951227.586918:0:19450:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951227.588392:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+29:15684:x1870607923942528:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 1507us (8585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.588403:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:2.0:1783951227.592195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.592340:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923942784 00000100:00100000:3.0:1783951227.592354:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923942784 00000100:00100000:3.0:1783951227.592429:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1783951227.592441:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+29:15684:x1870607923942784:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951227.592471:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951227.592499:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fad3 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951227.593028:0:17199:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1783951227.593037:0:17199:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1783951227.593064:0:17199:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1783951227.593311:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f98b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.593340:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f98b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.593353:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f98b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.593427:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fad3 expref: 32 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.593451:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f98b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fad3 expref: 31 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.593460:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692e400) 00010000:00010000:3.0:1783951227.593463:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951227.593466:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9200, rc 0) 00000100:00100000:3.0:1783951227.593567:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+31:15684:x1870607923942784:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1127us (1385us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1783951227.593576:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:2.0:1783951227.598466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.598796:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923943040 00000100:00100000:0.0:1783951227.598811:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923943040 00000100:00100000:0.0:1783951227.598890:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:0.0:1783951227.598901:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+31:15684:x1870607923943040:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951227.598979:0:17200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951227.599019:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9200/0x7645c8e1169f98b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fad3 expref: 31 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599042:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692e400) 00010000:00010000:0.0:1783951227.599052:0:17200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951227.599074:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599089:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599099:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599209:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599219:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599228:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599278:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599285:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599292:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599298:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951227.599303:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599310:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599332:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:0.0:1783951227.599335:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951227.599339:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599344:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f98c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599360:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599366:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599372:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599377:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951227.599379:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599386:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599393:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb50c31d1 (ffff9e0247830e00) 00010000:00010000:0.0:1783951227.599396:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951227.599398:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.599403:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2800/0x7645c8e1169f98c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb50c31d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951227.600122:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+30:15684:x1870607923943040:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1220us (1668us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951227.600132:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:1.0:1783951227.603844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.604364:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923943168 00000100:00100000:3.0:1783951227.604387:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923943168 00000100:00100000:3.0:1783951227.604468:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:3.0:1783951227.604479:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+30:15684:x1870607923943168:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951227.604507:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951227.604537:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f98ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fada expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.604581:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f98d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.604598:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.604611:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.604759:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f98ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fada expref: 32 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.604781:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f98d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fada expref: 31 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.604790:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:3.0:1783951227.604794:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951227.604803:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9000, rc 0) 00000100:00100000:3.0:1783951227.604882:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+31:15684:x1870607923943168:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 404us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.604890:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:1.0:1783951227.607756:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.608041:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923943424 00000100:00100000:3.0:1783951227.608055:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923943424 00000100:00100000:3.0:1783951227.608130:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:3.0:1783951227.608505:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+31:15684:x1870607923943424:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783951227.608625:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.608649:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.608664:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951227.608918:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1783951227.608930:0:17199:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 583256787212ns, next at 584256784152ns, rc = 0 00000004:00010000:3.0:1783951227.608998:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021caa454 reply state 00000000a7e11ffc transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.609014:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.609021:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:3.0:1783951227.609024:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783951227.609028:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951227.609911:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+33:15684:x1870607923943424:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1764us (2164us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1783951227.609948:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:1.0:1783951227.613920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.614027:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923943552 00000100:00100000:3.0:1783951227.614039:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923943552 00000100:00100000:3.0:1783951227.614183:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:3.0:1783951227.614196:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+33:15684:x1870607923943552:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783951227.614231:0:19450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951227.614267:0:19450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fae1 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.614358:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 34 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.614619:0:19450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 34 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.614708:0:19450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:1.0:1783951227.614713:0:19450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951227.614719:0:19450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8400, rc 0) 00000100:00100000:1.0:1783951227.614798:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+34:15684:x1870607923943552:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 604us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.614806:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1783951227.618137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.618427:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923943680 00000100:00100000:0.0:1783951227.618439:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923943680 00000100:00100000:0.0:1783951227.618532:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:0.0:1783951227.618560:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2408:x1870607923943680:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783951227.618883:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+6:2408:x1870607923943680:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 324us (757us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783951227.618892:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00080000:2.0:1783951227.619024:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951227.621725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.621837:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923943936 00000100:00100000:2.0:1783951227.621848:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923943936 00000100:00100000:2.0:1783951227.621915:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:2.0:1783951227.621927:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+34:15684:x1870607923943936:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783951227.622300:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+35:15684:x1870607923943936:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 374us (588us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1783951227.622310:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:3.0:1783951227.625614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.625784:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923944192 00000100:00100000:0.0:1783951227.625797:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923944192 00000100:00100000:0.0:1783951227.625872:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1783951227.625884:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+35:15684:x1870607923944192:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783951227.626045:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+35:15684:x1870607923944192:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 163us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.626054:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1783951227.629704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.629818:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923944320 00000100:00100000:2.0:1783951227.629831:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923944320 00000100:00100000:2.0:1783951227.629907:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:2.0:1783951227.629919:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+35:15684:x1870607923944320:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951227.629947:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951227.629974:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f98ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fae8 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.630072:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f98f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.630088:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.630102:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951227.630344:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951227.630371:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.630522:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948400/0x7645c8e1169f98ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae8 expref: 37 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.630565:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f98f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae8 expref: 36 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.630575:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:2.0:1783951227.630579:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783951227.630583:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949000, rc 0) 00000100:00100000:2.0:1783951227.630771:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+36:15684:x1870607923944320:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 853us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.630779:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:1.0:1783951227.635031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.635488:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923944448 00000100:00100000:0.0:1783951227.635501:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923944448 00000100:00100000:0.0:1783951227.635618:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783951227.635630:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e128-5618-477b-951f-a759707c8cef+6:2408:x1870607923944448:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951227.635656:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951227.635689:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3faef expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951227.635725:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54ef7b, blocks: 0x0 00010000:00010000:0.0:1783951227.635751:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=583s v=(0 0) 00010000:00010000:0.0:1783951227.635756:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951227.635769:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.635822:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.635840:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2600, rc 0) 00000100:00100000:0.0:1783951227.635927:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e128-5618-477b-951f-a759707c8cef+7:2408:x1870607923944448:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 299us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.635935:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:2.0:1783951227.638673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.639064:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923944704 00000100:00100000:3.0:1783951227.639076:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923944704 00000100:00100000:3.0:1783951227.639186:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:3.0:1783951227.639198:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+36:15684:x1870607923944704:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783951227.639568:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+36:15684:x1870607923944704:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 371us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.639577:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:2.0:1783951227.642552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.642660:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923944832 00000100:00100000:1.0:1783951227.642672:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923944832 00000100:00100000:1.0:1783951227.642770:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:1.0:1783951227.642782:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+36:15684:x1870607923944832:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783951227.645181:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1783951227.645204:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783951227.645268:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1783951227.645355:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.645369:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.645533:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.645542:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951227.645548:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.645557:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.645579:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:0.0:1783951227.645582:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783951227.645601:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.645609:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949a00/0x7645c8e1169f9785 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951227.645806:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+19:15684:x1870607923944832:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 3018us (3260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.645818:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:1.0:1783951227.645994:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951227.646014:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944989824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783951227.646089:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951227.646168:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944989824 00000100:00100000:1.0:1783951227.646176:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944989824 00000100:00100000:1.0:1783951227.646230:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951227.646732:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944989824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783951227.646905:0:19194:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783951227.646909:0:19194:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783951227.646911:0:19194:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783951227.646912:0:19194:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783951227 -> 1783951227 00002000:00010000:1.0:1783951227.646914:0:19194:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783951227.646971:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607944989824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 734us (882us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783951227.646980:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1783951227.647092:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0248394700/2, rc 0, transno 8589934596 00000100:00100000:2.0:1783951227.647099:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944989824:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1783951227.647500:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647521:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647529:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647536:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.647541:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647549:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647566:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e0247826400) 00010000:00010000:3.0:1783951227.647570:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951227.647574:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647580:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948200/0x7645c8e1169f9731 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647603:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647609:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647615:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647621:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.647631:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647638:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647647:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:3.0:1783951227.647649:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951227.647652:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647658:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948000/0x7645c8e1169f9738 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647671:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647677:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647683:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647688:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.647690:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647696:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647704:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e03438c0100) 00010000:00010000:3.0:1783951227.647706:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951227.647717:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647723:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c3e00/0x7645c8e1169f97e0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647743:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647750:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647756:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647761:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.647765:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647771:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647780:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.647782:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951227.647785:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647790:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f9865 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647804:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647821:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647827:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647832:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.647835:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647842:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647851:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:3.0:1783951227.647853:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783951227.647856:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.647861:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f98dc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.652255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.652810:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923944960 00000100:00100000:1.0:1783951227.652824:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923944960 00000100:00100000:1.0:1783951227.652902:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1783951227.652924:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+7:2407:x1870607923944960:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783951227.653071:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+7:2407:x1870607923944960:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 159us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.653080:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1783951227.657272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.657586:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923945216 00000100:00100000:2.0:1783951227.657601:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923945216 00000100:00100000:2.0:1783951227.657672:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:2.0:1783951227.657685:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+15:15684:x1870607923945216:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783951227.657759:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951227.657793:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949000/0x7645c8e1169f98f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae8 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.657815:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:2.0:1783951227.657822:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951227.657878:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.657906:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.657920:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951227.658095:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000046b2799 reply state 00000000c56e4ab7 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.658110:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.658118:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:2.0:1783951227.658120:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951227.658123:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951227.658686:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e128-5618-477b-951f-a759707c8cef+16:15684:x1870607923945216:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1001us (1433us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783951227.658696:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:2.0:1783951227.663490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.663615:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923945344 00000100:00100000:1.0:1783951227.663630:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923945344 00000100:00100000:1.0:1783951227.663739:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:1.0:1783951227.663752:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+7:15684:x1870607923945344:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951227.663778:0:19194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951227.663801:0:19194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3faf6 expref: -99 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.663845:0:19194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 8 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.663872:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951227.663878:0:19194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951227.663884:0:19194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 8 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.663930:0:19194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 8 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.663947:0:19194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 8 pid: 18707 timeout: 683 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951227.663964:0:19194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19194:1870607944989952:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951227.664122:0:19194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02480a4780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951227.668552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.668627:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923945472 00000100:00100000:3.0:1783951227.668639:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923945472 00010000:00010000:3.0:1783951227.668692:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 9 pid: 18707 timeout: 683 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.668743:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:3.0:1783951227.668756:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e128-5618-477b-951f-a759707c8cef+9:2408:x1870607923945472:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783951227.668775:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951227.668823:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 9 pid: 18707 timeout: 683 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.668841:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 9 pid: 18707 timeout: 683 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.668873:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951227.668878:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951227.668886:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.668897:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.668943:0:17185:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.668959:0:17185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17185:1870607944990080:192.168.202.33@tcp:105: 00010000:00010000:0.0:1783951227.669109:0:19194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cedc570/0x7645c8e1169f98f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faef expref: 9 pid: 18707 timeout: 683 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951227.669127:0:19194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19194:1870607944989952:192.168.202.33@tcp:104: 00010000:00010000:0.0:1783951227.669192:0:19194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 8 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.669204:0:19194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2c00, rc 0) 00000100:00100000:3.0:1783951227.669975:0:17185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951227.670052:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+8:15684:x1870607923945344:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 6301us (6574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.670063:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:2.0:1783951227.674019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.674114:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923945600 00000100:00100000:1.0:1783951227.674126:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923945600 00000100:00100000:1.0:1783951227.674226:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:1.0:1783951227.674248:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+8:2408:x1870607923945600:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783951227.674626:0:18708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783951227.674630:0:18708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783951227 00002000:00010000:1.0:1783951227.674633:0:18708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783951226 00002000:00010000:1.0:1783951227.674635:0:18708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783951227 -> 1783951227 00002000:00010000:1.0:1783951227.674638:0:18708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783951227.674713:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e128-5618-477b-951f-a759707c8cef+9:2408:x1870607923945600:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 476us (705us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783951227.674746:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:0.0:1783951227.675865:0:17185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17185:1870607944990080:192.168.202.33@tcp:105: 00010000:00010000:0.0:1783951227.675897:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951227.675954:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e128-5618-477b-951f-a759707c8cef+8:2408:x1870607923945472:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 7201us (7419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.675965:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783951227.679991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.680101:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923945728 00000100:00100000:2.0:1783951227.680114:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923945728 00000100:00100000:2.0:1783951227.680222:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:2.0:1783951227.680493:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+8:2408:x1870607923945728:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783951227.680560:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.680614:0:18709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 8 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.680625:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951227.680630:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951227.680636:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.680686:0:18709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 8 pid: 19194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.680702:0:18709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 8 pid: 19194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.680721:0:18709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18709:1870607944990208:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951227.680836:0:18709:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03484f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951227.685503:0:18709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18709:1870607944990208:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951227.685543:0:18709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.685695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951227.686033:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923945856 00000100:00100000:2.0:1783951227.686042:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923945856 00010000:00010000:2.0:1783951227.686085:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.686230:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:2.0:1783951227.686250:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+9:2408:x1870607923945856:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951227.686277:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951227.686309:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.686336:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.686364:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000401f53f0/0x7645c8e1169f9906 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3faf6 expref: 9 pid: 19194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.686747:0:18355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951227.686753:0:18355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951227.686761:0:18355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.686773:0:18355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.686811:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951227.686890:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+8:2408:x1870607923945856:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 649us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.686899:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00010000:00010000:1.0:1783951227.686972:0:18709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.686983:0:18709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687009:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687019:0:18709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687027:0:18709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687034:0:18709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951227.687039:0:18709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687048:0:18709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687063:0:18709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.687079:0:18709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae921c9c/0x7645c8e1169f990d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951227.687132:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+7:2408:x1870607923945728:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 6900us (7155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.687181:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:1.0:1783951227.690080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.690200:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923946112 00000100:00100000:3.0:1783951227.690212:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923946112 00000100:00100000:3.0:1783951227.690722:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:3.0:1783951227.690735:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+16:15684:x1870607923946112:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783951227.690852:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.690895:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 16 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.690906:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.690952:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 16 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.690966:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 16 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.690983:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870607944990336:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951227.691614:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951227.693994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.694066:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870607944990336:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951227.694097:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951227.694757:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923946240 00000100:00100000:0.0:1783951227.694769:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923946240 00010000:00010000:1.0:1783951227.694923:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951227.694998:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1783951227.695008:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e128-5618-477b-951f-a759707c8cef+17:2407:x1870607923946240:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951227.695027:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951227.695035:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695048:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695077:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8200/0x7645c8e1169f985e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab7 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695109:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951227.695117:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695128:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695135:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695489:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.695517:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951227.695589:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e128-5618-477b-951f-a759707c8cef+16:2407:x1870607923946240:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 581us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951227.695598:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00010000:00010000:3.0:1783951227.695702:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.695712:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.696011:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.696025:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 16 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.696033:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.696078:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 16 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.696092:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 16 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.696107:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870607944990464:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951227.696220:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038117cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951227.701011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.701121:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870607944990464:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951227.701198:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.701618:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923946368 00000100:00100000:2.0:1783951227.701627:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923946368 00010000:00010000:2.0:1783951227.701673:0:18355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.701755:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:2.0:1783951227.701767:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+17:2408:x1870607923946368:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951227.701786:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951227.701794:0:18355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.701809:0:18355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.701834:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8400/0x7645c8e1169f98e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fae1 expref: 17 pid: 19450 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.701853:0:18355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:2.0:1783951227.701859:0:18355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.701871:0:18355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.701880:0:18355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951227.701915:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951227.701987:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e128-5618-477b-951f-a759707c8cef+16:2408:x1870607923946368:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 221us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951227.702004:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00010000:00010000:3.0:1783951227.702245:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.702254:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951227.702605:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1783951227.702763:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1783951227.702812:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1783951227.702926:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870607944990592:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783951227.702993:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951227.703086:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951227.705064:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944990592 00000100:00100000:0.0:1783951227.705084:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944990592 00000100:00100000:0.0:1783951227.705852:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783951227.705868:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1870607944990592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783951227.706048:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1870607944990592:12345-0@lo:1000:mdt00_002.0 Request processed in 186us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.706057:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951227.706177:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870607944990592:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783951227.706474:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1783951227.706571:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870607944990720:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783951227.706638:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951227.707074:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951227.707181:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944990720 00000100:00100000:1.0:1783951227.707190:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944990720 00000100:00100000:1.0:1783951227.707227:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951227.707247:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17201:x1870607944990720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783951227.707632:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17201:x1870607944990720:12345-0@lo:1000:mdt00_002.0 Request processed in 396us (993us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783951227.707640:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783951227.707729:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870607944990720:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783951227.707784:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707797:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707806:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707813:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.707819:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707827:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707846:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:3.0:1783951227.707849:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951227.707855:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707862:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9e00/0x7645c8e1169f991b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707901:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707907:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707922:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707928:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951227.707930:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707937:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707946:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:3.0:1783951227.707949:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783951227.707958:0:17201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707971:0:17201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.707981:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.708044:0:17201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.708058:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870607944990848:192.168.202.33@tcp:105: 00000100:00100000:3.0:1783951227.708183:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951227.711052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.711220:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870607944990848:192.168.202.33@tcp:105: 00010000:00010000:1.0:1783951227.711266:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711291:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949c00/0x7645c8e1169f9873 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.711501:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923946496 00000100:00100000:3.0:1783951227.711514:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923946496 00000100:00100000:3.0:1783951227.711571:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:3.0:1783951227.711582:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e519850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+20:15682:x1870607923946496:12345-192.168.202.33@tcp:49:dd.0 00000100:00100000:3.0:1783951227.711730:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e519850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+20:15682:x1870607923946496:12345-192.168.202.33@tcp:49:dd.0 Request processed in 150us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951227.711738:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00010000:00010000:1.0:1783951227.711829:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711846:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711859:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711870:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711877:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711884:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711890:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951227.711894:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711902:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711912:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951227.711915:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951227.711919:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711933:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2800/0x7645c8e1169f9922 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711945:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711951:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711957:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711963:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951227.711966:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711971:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711978:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951227.711980:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951227.711982:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.711988:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8000/0x7645c8e1169f9914 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951227.712171:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+19:15684:x1870607923946112:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 21438us (22105us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783951227.712179:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000020:00080000:1.0:1783951227.712187:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783951227.713096:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783951227.713104:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951227.713131:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783951227.713138:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783951227.716122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951227.716213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.716503:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923946880 00000100:00100000:0.0:1783951227.716516:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923946880 00000100:00100000:0.0:1783951227.716591:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:0.0:1783951227.716605:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+19:15682:x1870607923946880:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:0.0:1783951227.716640:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951227.716669:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9929 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fafd expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.716709:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3200/0x7645c8e1169f9930 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.716728:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3200/0x7645c8e1169f9930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.716740:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3200/0x7645c8e1169f9930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.716898:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9929 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fafd expref: 21 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.716919:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3200/0x7645c8e1169f9930 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fafd expref: 20 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951227.716936:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:0.0:1783951227.716939:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951227.716944:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3200, rc 0) 00000100:00100000:0.0:1783951227.717011:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+20:15682:x1870607923946880:12345-192.168.202.33@tcp:101:dd.0 Request processed in 410us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951227.717020:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:3.0:1783951227.717804:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923946752 00000100:00100000:3.0:1783951227.717813:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923946752 00000100:00100000:3.0:1783951227.717859:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:3.0:1783951227.717868:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+20:15684:x1870607923946752:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783951227.718217:0:17203:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783951227.718278:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1783951227.718326:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.718342:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.718353:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.718362:0:17203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.718369:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.719130:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.721566:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951227.721583:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.721596:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951227.721602:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.721612:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.721633:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:1.0:1783951227.721636:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951227.721641:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 3/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951227.721649:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951227.721650:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951227.721652:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951227.721781:0:17203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951227.721791:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9400/0x7645c8e1169f9937 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951227.721938:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+22:15684:x1870607923946752:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 4064us (5824us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1783951227.721950:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000020:00080000:3.0:1783951227.721957:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783951227.989720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951227.989900:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947008 00000100:00100000:3.0:1783951227.989914:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947008 00000100:00100000:3.0:1783951227.990002:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1783951227.990015:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e04e128-5618-477b-951f-a759707c8cef+7:2409:x1870607923947008:12345-192.168.202.33@tcp:4:dd.0 00002000:00010000:3.0:1783951227.990079:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a54ef7b, atime: 0x6a54ef7a, ctime: 0x6a54ef7b, blocks: 0x0 00010000:00010000:3.0:1783951227.990090:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.990112:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=583s v=(0 0) 00010000:00010000:3.0:1783951227.990117:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951227.990125:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951227.990190:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951227.996754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951227.997280:0:18714:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951227.997293:0:18714:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1783951227.998470:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947136 00000100:00100000:1.0:1783951227.998493:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947136 00000100:00100000:0.0:1783951228.005538:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:0.0:1783951228.005564:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e04e128-5618-477b-951f-a759707c8cef+8:2410:x1870607923947136:12345-192.168.202.33@tcp:4:dd.0 00010000:00010000:0.0:1783951228.005617:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.005640:0:20339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951228.005645:0:20339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951228.005652:0:20339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.005668:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951228.125972:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1783951228.125993:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1783951228.127481:0:18712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1783951228.127489:0:18712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1783951228.127508:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951228.127521:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951228.127539:0:18712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951228.127548:0:18712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951228.127553:0:18712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951228.127563:0:18712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951228.127957:0:18712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951228.127968:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be6ddfa6/0x7645c8e1169f993e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951228.128245:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e04e128-5618-477b-951f-a759707c8cef+7:2409:x1870607923947008:12345-192.168.202.33@tcp:4:dd.0 Request processed in 138227us (138536us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783951228.128261:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000001:00080000:2.0:1783951228.170428:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1783951228.170634:0:20339:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1783951228.170640:0:20339:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1783951228.170658:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.170690:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.170700:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.170708:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951228.170713:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.170722:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.170741:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951228.170749:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5420bf8/0x7645c8e1169f9945 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951228.170881:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947136:12345-192.168.202.33@tcp:4:dd.0 Request processed in 165321us (174136us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783951228.170892:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00010000:00010000:1.0:1783951228.192446:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951228.682002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951228.682333:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947648 00000100:00100000:3.0:1783951228.682342:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947648 00000100:00100000:3.0:1783951228.682389:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948160 00000100:00100000:3.0:1783951228.682392:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948160 00000100:00100000:3.0:1783951228.682404:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947776 00000100:00100000:3.0:1783951228.682406:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947776 00000100:00100000:3.0:1783951228.682415:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948288 00000100:00100000:3.0:1783951228.682417:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948288 00000100:00100000:1.0:1783951228.682442:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947392 00000100:00100000:3.0:1783951228.682443:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:3.0:1783951228.682458:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947648:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951228.682458:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947392 00000100:00100000:1.0:1783951228.682524:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947904 00000100:00100000:1.0:1783951228.682531:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947904 00000100:00100000:3.0:1783951228.682543:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951228.682553:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:1.0:1783951228.682558:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947520 00000100:00100000:1.0:1783951228.682564:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947520 00000100:00100000:3.0:1783951228.682582:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:1.0:1783951228.682593:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948032 00000100:00100000:3.0:1783951228.682594:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923948160:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951228.682625:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948032 00000100:00100000:1.0:1783951228.682666:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:3.0:1783951228.682672:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038114ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923948160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951228.682686:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+22:2410:x1870607923947392:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951228.682698:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:3.0:1783951228.682722:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1783951228.682731:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947776:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951228.682784:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+22:2410:x1870607923947392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951228.682794:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:1.0:1783951228.682819:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:1.0:1783951228.682830:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2410:x1870607923947904:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951228.682836:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951228.682857:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923948288:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951228.682940:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:0.0:1783951228.682950:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947520:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951228.683017:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 287us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951228.683025:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1783951228.683060:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923947264 00000100:00100000:3.0:1783951228.683065:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923947264 00000100:00100000:3.0:1783951228.683098:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:3.0:1783951228.683104:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923947264:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951228.683556:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2410:x1870607923947904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 723us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951228.683577:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:1.0:1783951228.683937:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1783951228.683947:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923948032:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951228.694816:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923948288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 11920us (12498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951228.694839:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923947520:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 11890us (12613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951228.694888:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00080000:0.0:1783951228.695174:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951228.695180:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951228.695184:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951228.695186:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951228.696416:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:3.0:1783951228.705229:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923947264:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 22111us (23075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951228.705249:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:1.0:1783951228.708061:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923948032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24100us (25789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951228.708081:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000040:00080000:3.0:1783951228.768924:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783951228.768934:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951228.768953:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783951228.768961:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1783951229.220471:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951230.102708:0:20377:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783951230.242510:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951231.072904:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944990976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951231.072982:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951231.073173:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944990976 00000100:00100000:0.0:1783951231.073181:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944990976 00000100:00100000:0.0:1783951231.073256:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951231.073276:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944990976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951231.073318:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951231.073369:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944990976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951231.073377:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1783951231.073641:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951231.073680:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944990976:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783951231.274865:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951232.101402:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944991104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951232.101482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.102293:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991104 00000100:00100000:1.0:1783951232.102305:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991104 00000100:00100000:1.0:1783951232.102386:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951232.102397:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944991104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951232.102425:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951232.102730:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944991104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.102747:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951232.103262:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944991104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783951232.103307:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951232.289311:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42423 lines, 42423 kept, 0 dropped, 0 bad.